Theory of Mind in Freely-Told Children’s Narratives: A Classification Approach

Bram van Dijk, Marco Spruit, Max van Duijn


Abstract
Children are the focal point for studying the link between language and Theory of Mind (ToM) competence. Language and ToM are often studied with younger children and standardized tests, but as both are social competences, data and methods with higher ecological validity are critical. We leverage a corpus of 442 freely-told stories by Dutch children aged 4-12, recorded in their everyday classroom environments, to study language and ToM with NLP-tools. We labelled stories according to the mental depth of story characters children create, as a proxy for their ToM competence ‘in action’, and built a classifier with features encoding linguistic competences identified in existing work as predictive of ToM.We obtain good and fairly robust results (F1-macro = .71), relative to the complexity of the task for humans. Our results are explainable in that we link specific linguistic features such as lexical complexity and sentential complementation, that are relatively independent of children’s ages, to higher levels of character depth. This confirms and extends earlier work, as our study includes older children and socially embedded data from a different domain. Overall, our results support the idea that language and ToM are strongly interlinked, and that in narratives the former can scaffold the latter.
Anthology ID:
2023.findings-acl.822
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12979–12993
Language:
URL:
https://aclanthology.org/2023.findings-acl.822
DOI:
10.18653/v1/2023.findings-acl.822
Bibkey:
Cite (ACL):
Bram van Dijk, Marco Spruit, and Max van Duijn. 2023. Theory of Mind in Freely-Told Children’s Narratives: A Classification Approach. In Findings of the Association for Computational Linguistics: ACL 2023, pages 12979–12993, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Theory of Mind in Freely-Told Children’s Narratives: A Classification Approach (van Dijk et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.822.pdf