Narrative Cloze as a Training Objective: Towards Modeling Stories Using Narrative Chain Embeddings

Hans Ole Hatzel, Chris Biemann


Abstract
We present a novel approach to modeling narratives using narrative chain embeddings.A new dataset of narrative chains extracted from German news texts is presented. With neural methods, we produce models for both German and English that achieve state-of-the-art performance on the Multiple Choice Narrative Cloze task. Subsequently, we perform an extrinsic evaluation of the embeddings our models produce and show that they perform rather poorly in identifying narratively similar texts. We explore some of the reasons for this underperformance and discuss the upsides of our approach. We provide an outlook on alternative ways to model narratives, as well as techniques for evaluating such models.
Anthology ID:
2023.wnu-1.19
Volume:
Proceedings of the 5th Workshop on Narrative Understanding
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Nader Akoury, Elizabeth Clark, Mohit Iyyer, Snigdha Chaturvedi, Faeze Brahman, Khyathi Chandu
Venue:
WNU
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
118–127
Language:
URL:
https://aclanthology.org/2023.wnu-1.19
DOI:
10.18653/v1/2023.wnu-1.19
Bibkey:
Cite (ACL):
Hans Ole Hatzel and Chris Biemann. 2023. Narrative Cloze as a Training Objective: Towards Modeling Stories Using Narrative Chain Embeddings. In Proceedings of the 5th Workshop on Narrative Understanding, pages 118–127, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Narrative Cloze as a Training Objective: Towards Modeling Stories Using Narrative Chain Embeddings (Hatzel & Biemann, WNU 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.wnu-1.19.pdf
Video:
 https://aclanthology.org/2023.wnu-1.19.mp4