RPTCS: A Reinforced Persona-aware Topic-guiding Conversational System

Zishan Ahmad, Kshitij Mishra, Asif Ekbal, Pushpak Bhattacharyya


Abstract
Although there has been a plethora of work on open-domain conversational systems, most of the systems lack the mechanism of controlling the concept transitions in a dialogue. For activities like switching from casual chit-chat to task-oriented conversation, an agent with the ability to manage the flow of concepts in a conversation might be helpful. The user would find the dialogue more engaging and be more receptive to such transitions if these concept transitions were made while taking into account the user’s persona. Focusing on persona-aware concept transitions, we propose a Reinforced Persona-aware Topic-guiding Conversational System (RPTCS). Due to the lack of a persona-aware topic transition dataset, we propose a novel conversation dataset creation mechanism in which the conversational agent leads the discourse to drift to a set of target concepts depending on the persona of the speaker and the context of the conversation. To avoid scarcely available expensive human resource, the entire data-creation process is mostly automatic with human-in-loop only for quality checks. This created conversational dataset named PTCD is used to develop the RPTCS in two steps. First, a maximum likelihood estimation loss-based conversational model is trained on PTCD. Then this trained model is fine-tuned in a Reinforcement Learning (RL) framework by employing novel reward functions to assure persona, topic, and context consistency with non-repetitiveness in generated responses. Our experimental results demonstrate the strength of the proposed system with respect to strong baselines.
Anthology ID:
2023.eacl-main.253
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3482–3494
Language:
URL:
https://aclanthology.org/2023.eacl-main.253
DOI:
10.18653/v1/2023.eacl-main.253
Bibkey:
Cite (ACL):
Zishan Ahmad, Kshitij Mishra, Asif Ekbal, and Pushpak Bhattacharyya. 2023. RPTCS: A Reinforced Persona-aware Topic-guiding Conversational System. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 3482–3494, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
RPTCS: A Reinforced Persona-aware Topic-guiding Conversational System (Ahmad et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.253.pdf
Video:
 https://aclanthology.org/2023.eacl-main.253.mp4