Dango: A Strictly L1-Only Large Language Model for Studying Second Language Acquisition

Shiho Matta, Yin Jou Huang, Fei Cheng, Takashi Kodama, Hirokazu Kiyomaru, Yugo Murawaki


Abstract
We introduce Dango, a 1.8B-parameter large language model designed for controlled studies of L1→L2 (Japanese→English) transfer in second language acquisition (SLA). While previous studies have explored SLA in language models, they have predominantly relied on smaller or non-decoder models, limiting their ability to generate open-ended text and reducing their suitability as practical L2 simulators. We identify a key challenge when scaling models to this size: L2 contamination within the "monolingual" pretraining corpus used for L1 acquisition. To address this, we propose a filtering method to reduce premature exposure to English while preserving realistic, minimal exposure. We then fine-tune the model on LLM-generated L2-learning lessons to simulate the L2 acquisition process. Our evaluations show that Dango develops human-like L2 production patterns, reliably matching Japanese learners of English more closely than the multilingual baseline across our distributional metrics and the unfiltered baseline on our usage frequency metric. We release the model, data, and code to facilitate reproducible computational SLA research and learner-facing applications.
Anthology ID:
2026.emnlp-main.2633
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
59856–59876
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2633/
DOI:
Bibkey:
Cite (ACL):
Shiho Matta, Yin Jou Huang, Fei Cheng, Takashi Kodama, Hirokazu Kiyomaru, and Yugo Murawaki. 2026. Dango: A Strictly L1-Only Large Language Model for Studying Second Language Acquisition. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 59856–59876, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Dango: A Strictly L1-Only Large Language Model for Studying Second Language Acquisition (Matta et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2633.pdf