Redefining Proactivity for Information Seeking Dialogue

Jing Yang Lee, Seokhwan Kim, Kartik Mehta, Jiun-Yu Kao, Yu-Hsiang Lin, Arpit Gupta


Abstract
Humans pay careful attention to the interlocutor’s internal state in dialogues. For example, in recommendation dialogues, we make recommendations while estimating the seeker’s internal state, such as his/her level of knowledge and interest. Since there are no existing annotated resources for the analysis and experiment, we constructed RecomMind, a movie recommendation dialogue dataset with annotations of the seeker’s internal state at the entity level. Each entity has a first-person label annotated by the seeker and a second-person label annotated by the recommender. Our analysis based on RecomMind reveals that the success of recommendations is enhanced when recommenders mention entities that seekers do not know but are interested in. We also propose a response generation framework that explicitly considers the seeker’s internal state, utilizing the chain-of-thought prompting. The human evaluation results show that our proposed method outperforms the baseline method in both consistency and the success of recommendations.
Anthology ID:
2024.sicon-1.5
Volume:
Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024)
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
James Hale, Kushal Chawla, Muskan Garg
Venue:
SICon
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
64–84
Language:
URL:
https://aclanthology.org/2024.sicon-1.5
DOI:
Bibkey:
Cite (ACL):
Jing Yang Lee, Seokhwan Kim, Kartik Mehta, Jiun-Yu Kao, Yu-Hsiang Lin, and Arpit Gupta. 2024. Redefining Proactivity for Information Seeking Dialogue. In Proceedings of the Second Workshop on Social Influence in Conversations (SICon 2024), pages 64–84, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Redefining Proactivity for Information Seeking Dialogue (Lee et al., SICon 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.sicon-1.5.pdf