Using Large Language Models for Understanding Narrative Discourse

Andrew Piper, Sunyam Bagga


Abstract
In this study, we explore the application of large language models (LLMs) to analyze narrative discourse within the framework established by the field of narratology. We develop a set of elementary narrative features derived from prior theoretical work that focus on core dimensions of narrative, including time, setting, and perspective. Through experiments with GPT-4 and fine-tuned open-source models like Llama3, we demonstrate the models’ ability to annotate narrative passages with reasonable levels of agreement with human annotators. Leveraging a dataset of human-annotated passages spanning 18 distinct narrative and non-narrative genres, our work provides empirical support for the deictic theory of narrative communication. This theory posits that a fundamental function of storytelling is the focalization of attention on distant human experiences to facilitate social coordination. We conclude with a discussion of the possibilities for LLM-driven narrative discourse understanding.
Anthology ID:
2024.wnu-1.4
Volume:
Proceedings of the The 6th Workshop on Narrative Understanding
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yash Kumar Lal, Elizabeth Clark, Mohit Iyyer, Snigdha Chaturvedi, Anneliese Brei, Faeze Brahman, Khyathi Raghavi Chandu
Venue:
WNU
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
37–46
Language:
URL:
https://aclanthology.org/2024.wnu-1.4
DOI:
Bibkey:
Cite (ACL):
Andrew Piper and Sunyam Bagga. 2024. Using Large Language Models for Understanding Narrative Discourse. In Proceedings of the The 6th Workshop on Narrative Understanding, pages 37–46, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Using Large Language Models for Understanding Narrative Discourse (Piper & Bagga, WNU 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.wnu-1.4.pdf