Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions

Michel Olvera, Paraskevas Stamatiadis, Changhong Wang, Gaël Richard


Abstract
Large audio-language models (LALMs) excel at understanding and reasoning tasks over atomic sound events, yet their ability to infer higher-level human activities from such fine-grained events remains largely unexamined. Everyday human actions and activities, such as setting a table, cleaning the house, or preparing a breakfast emerge compositionally from temporally distributed sound events, requiring abstraction beyond the event-centric granularity that dominates current training and evaluation paradigms. Our benchmark evaluates a wide set of LALMs under a principled framework that tests how language-based reasoning, grounded in acoustic perception, structures sound abstractions into higher-level understanding. By systematically varying exemplar typicality and distractor similarity, our evaluation exposes that current models do not reliably perform compositional inference from atomic acoustic events to higher-level human activities solely from audio. All data, taxonomies, and evaluation scripts are publicly available on our companion website: https://alm-sounding-actions.onrender.com/
Anthology ID:
2026.findings-emnlp.2460
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52936–52950
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2460/
DOI:
Bibkey:
Cite (ACL):
Michel Olvera, Paraskevas Stamatiadis, Changhong Wang, and Gaël Richard. 2026. Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 52936–52950, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions (Olvera et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2460.pdf