Personalized Response Generation with Tensor Factorization

Zhenghui Wang, Lingxiao Luo, Diyi Yang


Abstract
Personalized response generation is essential for more human-like conversations. However, how to model user personalization information with no explicit user persona descriptions or demographics still remains under-investigated. To tackle the data sparsity problem and the huge number of users, we utilize tensor factorization to model users’ personalization information with their posting histories. Specifically, we introduce the personalized response embedding for all question-user pairs and form them into a three-mode tensor, decomposed by Tucker decomposition. The personalized response embedding is fed to either the decoder of an LSTM-based Seq2Seq model or a transformer language model to help generate more personalized responses. To evaluate how personalized the generated responses are, we further propose a novel ranking-based metric called Per-Hits@k which measures how likely are the generated responses come from the corresponding users. Results on a large-scale conversation dataset show that our proposed tensor factorization based models generate more personalized and higher quality responses compared to baselines.
Anthology ID:
2021.gem-1.5
Volume:
Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Antoine Bosselut, Esin Durmus, Varun Prashant Gangal, Sebastian Gehrmann, Yacine Jernite, Laura Perez-Beltrachini, Samira Shaikh, Wei Xu
Venue:
GEM
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
47–57
Language:
URL:
https://aclanthology.org/2021.gem-1.5
DOI:
10.18653/v1/2021.gem-1.5
Bibkey:
Cite (ACL):
Zhenghui Wang, Lingxiao Luo, and Diyi Yang. 2021. Personalized Response Generation with Tensor Factorization. In Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021), pages 47–57, Online. Association for Computational Linguistics.
Cite (Informal):
Personalized Response Generation with Tensor Factorization (Wang et al., GEM 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.gem-1.5.pdf