The LSG Challenge Workshop at INLG 2024: Prompting Techniques for Crafting Extended Narratives with LLMs

Aleksandr Boriskin, Daria Galimzianova


Abstract
The task of generating long narratives using Large Language Models (LLMs) is a largely unexplored area within natural language processing (NLP). Although modern LLMs can handle up to 1 million tokens, ensuring coherence and control over long story generation is still a significant challenge. This paper investigates the use of summarization techniques to create extended narratives, specifically targeting long stories. We propose a special prompting scheme that segments the narrative into several parts and chapters, each generated iteratively with contextual information. Our approach is evaluated with GAPELMAPER, a sophisticated text coherence metric, for automatic evaluation to maintain the structural integrity of the generated stories. We also rely on human evaluation to assess the quality of the generated text. This research advances the development of tools for long story generation in NLP, highlighting both the potential and current limitations of LLMs in this field.
Anthology ID:
2024.inlg-genchal.13
Volume:
Proceedings of the 17th International Natural Language Generation Conference: Generation Challenges
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editors:
Simon Mille, Miruna-Adriana Clinciu
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
118–122
Language:
URL:
https://aclanthology.org/2024.inlg-genchal.13
DOI:
Bibkey:
Cite (ACL):
Aleksandr Boriskin and Daria Galimzianova. 2024. The LSG Challenge Workshop at INLG 2024: Prompting Techniques for Crafting Extended Narratives with LLMs. In Proceedings of the 17th International Natural Language Generation Conference: Generation Challenges, pages 118–122, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
The LSG Challenge Workshop at INLG 2024: Prompting Techniques for Crafting Extended Narratives with LLMs (Boriskin & Galimzianova, INLG 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.inlg-genchal.13.pdf