Changhong Wang
Author directory2026
Probing Large Audio-Language Models for Compositional Understanding of Sounding Actions
Michel Olvera | Paraskevas Stamatiadis | Changhong Wang | Gaël Richard
Findings of the Association for Computational Linguistics: EMNLP 2026
Michel Olvera | Paraskevas Stamatiadis | Changhong Wang | Gaël Richard
Findings of the Association for Computational Linguistics: EMNLP 2026
Large audio-language models (LALMs) excel at understanding and reasoning tasks over atomic sound events, yet their ability to infer higher-level human activities from such fine-grained events remains largely unexamined. Everyday human actions and activities, such as setting a table, cleaning the house, or preparing a breakfast emerge compositionally from temporally distributed sound events, requiring abstraction beyond the event-centric granularity that dominates current training and evaluation paradigms. Our benchmark evaluates a wide set of LALMs under a principled framework that tests how language-based reasoning, grounded in acoustic perception, structures sound abstractions into higher-level understanding. By systematically varying exemplar typicality and distractor similarity, our evaluation exposes that current models do not reliably perform compositional inference from atomic acoustic events to higher-level human activities solely from audio. All data, taxonomies, and evaluation scripts are publicly available on our companion website: https://alm-sounding-actions.onrender.com/
2025
iKnow-audio: Integrating Knowledge Graphs with Audio-Language Models
Michel Olvera | Changhong Wang | Paraskevas Stamatiadis | Gaël Richard | Slim Essid
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Michel Olvera | Changhong Wang | Paraskevas Stamatiadis | Gaël Richard | Slim Essid
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Contrastive Language–Audio Pretraining (CLAP) models learn by aligning audio and text in a shared embedding space, enabling powerful zero-shot recognition. However, their performance is highly sensitive to prompt formulation and language nuances, and they often inherit semantic ambiguities and spurious correlations from noisy pretraining data. While prior work has explored prompt engineering, adapters, and prefix tuning to address these limitations, the use of structured prior knowledge remains largely unexplored. We present iKnow-audio, a framework that integrates knowledge graphs with audio-language models to provide robust semantic grounding. iKnow-audio builds on the Audio-centric Knowledge Graph (AKG), which encodes ontological relations comprising semantic, causal, and taxonomic connections reflective of everyday sound scenes and events. By training knowlege graph embedding models on the AKG and refining CLAP predictions through this structured knowledge, iKnow-audio improves disambiguation of acoustically similar sounds and reduces reliance on prompt engineering. Comprehensive zero-shot evaluations across six benchmark datasets demonstrate consistent gains over baseline CLAP, supported by embedding-space analyses that highlight improved relational grounding. Resources are publicly available at https://github.com/michelolzam/iknow-audio