CSAVocoder: A Causal Spatial Audio Vocoder Towards Real-Time Spatial Audio Generation

Zhiyuan Zhu, Han Wang, Wenxiang Guo, Yu Zhang, Changhao Pan, Rui Yang, Zhou Zhao


Abstract
Spatial audio vocoders are able to convertmel-spectrograms produced by generative mod-els into spatial audio waveforms. Most neural vocoders are designed for monaural audio, and direct extensions to spatial audio can de-grade spatial quality by ignoring inter-channelcues. We present CSAVocoder, a causal GAN-based spatial audio vocoder that jointly optimizes waveform fidelity and spatial rendering. Our framework introduces a Spatial Adaptor that fuses multi-channel mel-spectrograms with dynamic source-listener pose information, together with a spatial consistency discriminator that supervises inter-channel cues.To meet real-time requirements, we design a strictly causal, stateful generator that supports efficient streaming inference with constant memory overhead. Experiments on largescale spatial audio datasets show that CSAVocoder improves spatial fidelity at competitive audio quality and real-time performance.Our project page is at: https://github.com/MM-Speech/CSAVocoder.
Anthology ID:
2026.emnlp-main.496
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
11394–11416
Language:
URL:
https://aclanthology.org/2026.emnlp-main.496/
DOI:
Bibkey:
Cite (ACL):
Zhiyuan Zhu, Han Wang, Wenxiang Guo, Yu Zhang, Changhao Pan, Rui Yang, and Zhou Zhao. 2026. CSAVocoder: A Causal Spatial Audio Vocoder Towards Real-Time Spatial Audio Generation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 11394–11416, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CSAVocoder: A Causal Spatial Audio Vocoder Towards Real-Time Spatial Audio Generation (Zhu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.496.pdf