Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models

Jing Liu, Marianne Schweitzer, Abdellah Fourtassi


Abstract
Social interaction is central to children’s language learning, but the effects of different forms of caregiver feedback are difficult to isolate in naturalistic data. We use child-like language models as controlled learners to test which forms of feedback support grammatical development. Small GPT-2-style models are pretrained on child-directed language from CHILDES, then fine-tuned with reinforcement learning using reward models trained to capture four feedback types: communicative feedback, structural alignment, semantic contingency, and affective feedback. Reward fine-tuning yields limited gains on minimal-pair evaluations, but clearer effects in free generation. Structural alignment produces the strongest improvements in grammaticality, while communicative feedback yields more moderate gains. In contrast, semantic contingency and affective feedback do not improve grammaticality. These results suggest that caregiver feedback is not uniformly beneficial: different forms of social feedback support different aspects of language learning.
Anthology ID:
2026.emnlp-main.2489
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
56512–56525
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2489/
DOI:
Bibkey:
Cite (ACL):
Jing Liu, Marianne Schweitzer, and Abdellah Fourtassi. 2026. Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 56512–56525, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2489.pdf