From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment

Jing Ye, Lu Xiang, Yaping Zhang, Chengqing Zong


Abstract
Effective emotional support hinges on understanding users’ emotions and needs to provide meaningful comfort during multi-turn interactions. Large Language Models (LLMs) show great potential for expressing empathy; however, they often deliver generic responses that fail to address users’ specific needs. To tackle this issue, we propose a self-evolution framework designed to help LLMs improve their responses to better align with users’ implicit preferences concerning personality, emotional state, and specific context. Our framework consists of two distinct phases: (1) Emotional Support Experience Acquisition, where LLMs are fine-tuned on limited emotional support conversation data to provide basic support, and (2) Self-Improvement for Personalized Emotional Support, where LLMs leverage self-reflection and self-refinement to generate personalized responses. Through iterative direct preference optimization between the pre- and post-refined responses, our model generates responses that reflect a better understanding of the user’s implicit preferences. Extensive experiments and evaluations demonstrate that our method significantly enhances the model’s performance in emotional support, reducing unhelpful responses and minimizing discrepancies between user preferences and model outputs.
Anthology ID:
2025.findings-emnlp.1024
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2025
Month:
November
Year:
2025
Address:
Suzhou, China
Editors:
Christos Christodoulopoulos, Tanmoy Chakraborty, Carolyn Rose, Violet Peng
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
18826–18853
Language:
URL:
https://aclanthology.org/2025.findings-emnlp.1024/
DOI:
Bibkey:
Cite (ACL):
Jing Ye, Lu Xiang, Yaping Zhang, and Chengqing Zong. 2025. From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 18826–18853, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
From Generic Empathy to Personalized Emotional Support: A Self-Evolution Framework for User Preference Alignment (Ye et al., Findings 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.findings-emnlp.1024.pdf
Checklist:
 2025.findings-emnlp.1024.checklist.pdf