A retrospective analysis on the use of LLMs to study infant syntax learning

Hélie Bazin, Anouk Barberousse, François Yvon


Abstract
Large language models (LLMs) have increasingly been used to investigate how children acquire syntax at an early stage of development. This is notably the central scientific goal of the BabyLM challenge, a community-wide effort to develop models that achieve human-level syntactic performance while being trained on developmentally realistic corpora. In this paper, we reflect on the use of LLMs in the study of infant syntax learning by providing an epistemological assessment of several studies from this research program. We discuss how datasets are built, which models are implemented, how they are trained and syntactically evaluated. We observe significant assumptions in the methodology of BabyLM and related studies, thus mitigating their theoretical scope. We additionally observe that using developmentally-realistic corpora have limited effects on models performance on commonly-used benchmarks, which suggest important computational differences between LLMs and the infant syntax learner.
Anthology ID:
2026.emnlp-main.2181
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
49590–49606
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2181/
DOI:
Bibkey:
Cite (ACL):
Hélie Bazin, Anouk Barberousse, and François Yvon. 2026. A retrospective analysis on the use of LLMs to study infant syntax learning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 49590–49606, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A retrospective analysis on the use of LLMs to study infant syntax learning (Bazin et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2181.pdf