A Web-Derived Typology of Multimodal Infant Crying: Taxonomy, a Text-Only Web-Corpus Comparison, and Ethical Issues

Jacob Rigal, Jonathan Ginzburg


Abstract
Web video platforms contain naturally occurring audiovisual interaction, but their use as corpora requires explicit decisions about selection, metadata, annotation, privacy, and redistribution. We present a curated corpus of 256 YouTube videos of infants crying, covering vaccination, discomfort, fussiness, colic, hunger, birth, sleepiness, overstimulation, and other pain contexts. Candidate videos were identified through keyword searches and annotated from audiovisual evidence. To test what is lost when cry context is inferred from web text alone, we add a supporting analysis of the enTenTen21 web corpus. From 14,936 baby + CRY concordance lines, 1,816 cases were conservatively assigned to our ten shared cry-context labels; a complementary causative MAKE + infant/baby + CRY search revealed substantial formulaic and pragmatic noise. A close examination of Other Pain recovered supplementary distinctions such as teething/oral pain, circumcision, medical procedures, restraint, burns, and general injury. The comparison shows why retrieval evidence should remain distinct from audiovisual annotation. The corpus is a resource for modeling the cognitive and dialogic factors surrounding infant paralinguistic signals in caregiver and medical interaction. A pilot study on the vaccination videos in our audiovisual corpus illustrates how event-level annotation links cry pulses to procedures and adult responses.
Anthology ID:
2026.wac-1.29
Volume:
Proceedings of the 13th Web-as-Corpus Workshop
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Pedro Ortiz Suarez, Laurie Burchell, Nikola Ljubešić, Yves Scherrer, Veronika Laippala, Vuk Dinić, Thom Vaughan
Venues:
WAC | WS
SIG:
SIGWAC
Publisher:
Association for Computational Linguistics
Note:
Pages:
331–346
Language:
URL:
https://aclanthology.org/2026.wac-1.29/
DOI:
Bibkey:
Cite (ACL):
Jacob Rigal and Jonathan Ginzburg. 2026. A Web-Derived Typology of Multimodal Infant Crying: Taxonomy, a Text-Only Web-Corpus Comparison, and Ethical Issues. In Proceedings of the 13th Web-as-Corpus Workshop, pages 331–346, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Web-Derived Typology of Multimodal Infant Crying: Taxonomy, a Text-Only Web-Corpus Comparison, and Ethical Issues (Rigal & Ginzburg, WAC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wac-1.29.pdf