Story Co-telling Dialogue Generation based on Multi-Agent Reinforcement Learning and Story Highlights

Yu-Kai Lee, Chia-Hui Chang


Abstract
Retelling a story is one way to develop narrative skills in students, but it may present some challenges for English as Second Language (ESL) students who are learning new stories and vocabularies at the same time. The goal of this research is to develop a dialogue module for story co-telling for ESL students in order to help students to co-narrate an English story and enhance their narrative skills. However, story co-telling is a relatively underexplored and novel task. In order to understand the story content and select the right plot to continue the story co-telling based on the current dialogue, we utilize open domain information extraction techniques to construct a knowledge graph, and adopt multi-agent reinforcement learning methods to train two agents to select relevant facts from the knowledge graph and generate responses, jointly accomplishing the task of story co-telling. Compared to models that reply on chronological order, our model improves the performance from 67.0% to 70.8% through self-training with reward evaluation, achieving an increase of approximately 3.8%.
Anthology ID:
2023.alta-1.2
Volume:
Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association
Month:
November
Year:
2023
Address:
Melbourne, Australia
Editors:
Smaranda Muresan, Vivian Chen, Kennington Casey, Vandyke David, Dethlefs Nina, Inoue Koji, Ekstedt Erik, Ultes Stefan
Venue:
ALTA
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–19
Language:
URL:
https://aclanthology.org/2023.alta-1.2
DOI:
Bibkey:
Cite (ACL):
Yu-Kai Lee and Chia-Hui Chang. 2023. Story Co-telling Dialogue Generation based on Multi-Agent Reinforcement Learning and Story Highlights. In Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association, pages 11–19, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Story Co-telling Dialogue Generation based on Multi-Agent Reinforcement Learning and Story Highlights (Lee & Chang, ALTA 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.alta-1.2.pdf