Spatial Audio Question Answering and Reasoning on Dynamic Source Movements

Arvind Krishna Sridhar, Yinyi Guo, Erik Visser


Abstract
Spatial audio understanding aims to enable machines to interpret complex auditory scenes, particularly when sound sources move over time. In this work, we study Spatial Audio Question Answering (SAQA) with a focus on movement reasoning, where a model must infer object motion, position and directional changes directly from stereo audio. First, we introduce a movement-centric spatial audio augmentation framework that synthesizes diverse motion patterns from isolated mono audio events, enabling controlled and scalable training data generation. Second, we propose an end-to-end multimodal finetuning approach with a thinking mode, which allows audio-language models to produce explicit intermediate reasoning steps before predicting an answer. Third, we investigate the impact of query-conditioned source separation as a preprocessing stage and compare three inference regimes: no masking, an audio grounding model (AGM), and ground-truth masks. Our results show that the benefits of thinking mode are most pronounced when paired with high-quality source separation rather than in isolation, with an improvement of +5.1% when a single event is present in the question. These findings highlight the relationship between movement modeling, reasoning, and separation quality, offering new insights for advancing spatial audio understanding.
Anthology ID:
2026.findings-emnlp.132
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2680–2704
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.132/
DOI:
Bibkey:
Cite (ACL):
Arvind Krishna Sridhar, Yinyi Guo, and Erik Visser. 2026. Spatial Audio Question Answering and Reasoning on Dynamic Source Movements. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 2680–2704, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Spatial Audio Question Answering and Reasoning on Dynamic Source Movements (Sridhar et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.132.pdf