Stories for the Win: Creating and Evaluating a Synthetic Dutch Children’s Storytelling Dataset

Sabijn Perdijk, Gijs Wijnholds, Suzan Verberne, Max J. van Duijn


Abstract
Stories have been shown to be potentially valuable for language model pretraining because their semantics are largely self-grounded. Existing human storytelling datasets are relatively small, and existing synthetic datasets lack realism. Here we describe the guided synthesis of a story corpus that is both large and realistic. We evaluate a set of metrics for measuring the quality of individual stories, including coherence, surprise, complexity, as well for quality of the dataset as a whole. Using the metrics we extensively evaluate multiple prompting approaches and three small models (3-8B). Based on the results, we steer dataset generation to yield a high-quality ’synthetic twin’ of a Dutch children’s storytelling collection, similar in terms of lexical and semantic diversity, but much larger, which we call *Stories for the Win* (StoriesFTW). We validate our metrics and evaluate samples from our corpus with crowd, expert, and LLM judgements.
Anthology ID:
2026.babylm-main.36
Volume:
Proceedings of the Second BabyLM Workshop
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Leshem Choshen, Ryan Cotterell, Mustafa Omer Gul, Jaap Jumelet, Tal Linzen, Aaron Mueller, Suchir Salhan, Raj Sanjay Shah, Alex Warstadt, Ethan Gotlieb Wilcox
Venues:
BabyLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
459–478
Language:
URL:
https://aclanthology.org/2026.babylm-main.36/
DOI:
Bibkey:
Cite (ACL):
Sabijn Perdijk, Gijs Wijnholds, Suzan Verberne, and Max J. van Duijn. 2026. Stories for the Win: Creating and Evaluating a Synthetic Dutch Children’s Storytelling Dataset. In Proceedings of the Second BabyLM Workshop, pages 459–478, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Stories for the Win: Creating and Evaluating a Synthetic Dutch Children’s Storytelling Dataset (Perdijk et al., BabyLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.babylm-main.36.pdf