SPHERE: Automatic Music Upmixing via Audio Language Model Post-Training with Spatial Heuristics Rewards

Zixun Guo, Calvin Murdock, Sanjeel Parekh, W. Owen Brimijoin, Simon Dixon, Joshua Reiss, Ishwarya Ananthabhotla


Abstract
In this paper, we study the task of automatic music upmixing, wherein a system predicts spatial mixing parameters from a multi-stem recording. Different from existing methods that rely on task-specific music encoders, we approach this task via audio language model (ALM) post-training, leveraging rich representations from existing ALMs, which encode both music semantics and mixing knowledge. Specifically, we propose a post-training recipe that first employs rejection sampling SFT, followed by reinforcement learning (RL) with verifiable rewards (RLVR) via GRPO. We propose Sphere (Spatial Heuristic Rewards), a deterministic reward suite inspired by music mixing conventions, to guide our post-training. It consists of 6 perceptually-motivated sub-rewards and encourages the output mix to be centered, balanced and spacious. More broadly, our results suggest that expert domain knowledge can be encoded as verifiable rewards and distilled into language models, without task-specific architectures.
Anthology ID:
2026.emnlp-main.2673
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
60827–60838
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2673/
DOI:
Bibkey:
Cite (ACL):
Zixun Guo, Calvin Murdock, Sanjeel Parekh, W. Owen Brimijoin, Simon Dixon, Joshua Reiss, and Ishwarya Ananthabhotla. 2026. SPHERE: Automatic Music Upmixing via Audio Language Model Post-Training with Spatial Heuristics Rewards. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 60827–60838, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SPHERE: Automatic Music Upmixing via Audio Language Model Post-Training with Spatial Heuristics Rewards (Guo et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2673.pdf