Persona-Aware Alignment Framework for Personalized Dialogue Generation

Guanrong Li, Xinyu Liu, Zhen Wu, Xinyu Dai


Abstract
Personalized dialogue generation aims to leverage persona profiles and dialogue history to generate persona-relevant and consistent responses. Mainstream models typically rely on token-level language model training with persona dialogue data, such as Next Token Prediction, to implicitly achieve personalization, meaning that these methods tend to neglect the given personas and generate generic responses. To address this issue, we propose a novel Persona-Aware Alignment Framework (PAL), which directly treats persona alignment as the training objective of dialogue generation. Specifically, PAL employs a two-stage training method including Persona-Aware Learning and Persona Alignment, equipped with an easy-to-use inference strategy Select then Generate, to improve persona sensitivity and generate more persona-relevant responses at the semantics level. Through extensive experiments, we demonstrate that our framework outperforms many state-of-the-art personalized dialogue methods and large language models.
Anthology ID:
2025.tacl-1.77
Volume:
Transactions of the Association for Computational Linguistics, Volume 13
Month:
Year:
2025
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
1722–1742
Language:
URL:
https://aclanthology.org/2025.tacl-1.77/
DOI:
10.1162/tacl.a.57
Bibkey:
Cite (ACL):
Guanrong Li, Xinyu Liu, Zhen Wu, and Xinyu Dai. 2025. Persona-Aware Alignment Framework for Personalized Dialogue Generation. Transactions of the Association for Computational Linguistics, 13:1722–1742.
Cite (Informal):
Persona-Aware Alignment Framework for Personalized Dialogue Generation (Li et al., TACL 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.tacl-1.77.pdf