Chenyi Ding
Author directory2026
Reading Acquisition Order out of BabyLM Representations: Child-Scale Training Produces Developmentally Aligned Semantic Spaces
Chenyi Ding | Zachary Nicholas Houghton | Masoud Jasbi
Proceedings of the Second BabyLM Workshop
Chenyi Ding | Zachary Nicholas Houghton | Masoud Jasbi
Proceedings of the Second BabyLM Workshop
Children learn words in a strikingly consistent order, and much of this order can be predicted from word-level properties such as frequency and concreteness. We ask whether acquisition order information is also implicitly present in the internal representations of language models, and what linguistic factors drive this. We probe 18 public checkpoints that span three architecture families at matched size, data scales from 10 million to roughly 180 billion words, and the winning systems and official baselines of the three previous BabyLM challenges. A ridge read-out of frozen hidden states predicts Wordbank age of acquisition for 619 CDI words, with the probing layer chosen on training folds only. Models trained on child-scale data match or exceed their full-scale counterparts in every family. Masked and hybrid training objectives yield more aligned spaces than purely causal training, and challenge winners are not the most aligned systems. Geometric measures of semantic structure add predictive value beyond classic predictors only for child-scale models. AoA decodability thus provides a training-free measure of developmental alignment for BabyLM evaluation.