Sabijn Perdijk
Author directory2026
Stories for the Win: Creating and Evaluating a Synthetic Dutch Children’s Storytelling Dataset
Sabijn Perdijk | Gijs Wijnholds | Suzan Verberne | Max J. van Duijn
Proceedings of the Second BabyLM Workshop
Sabijn Perdijk | Gijs Wijnholds | Suzan Verberne | Max J. van Duijn
Proceedings of the Second BabyLM Workshop
Stories have been shown to be potentially valuable for language model pretraining because their semantics are largely self-grounded. Existing human storytelling datasets are relatively small, and existing synthetic datasets lack realism. Here we describe the guided synthesis of a story corpus that is both large and realistic. We evaluate a set of metrics for measuring the quality of individual stories, including coherence, surprise, complexity, as well for quality of the dataset as a whole. Using the metrics we extensively evaluate multiple prompting approaches and three small models (3-8B). Based on the results, we steer dataset generation to yield a high-quality ’synthetic twin’ of a Dutch children’s storytelling collection, similar in terms of lexical and semantic diversity, but much larger, which we call *Stories for the Win* (StoriesFTW). We validate our metrics and evaluate samples from our corpus with crowd, expert, and LLM judgements.