Haoning Xu
Author directory2026
MTR-DuplexBench: Towards a Comprehensive Evaluation of Multi-Round Conversations for Full-Duplex Speech Language Models
Zhang He | Wenqian Cui | Haoning Xu | Xiao-Hui Li | Lei Zhu | Haoli Bai | Ma Shaohua | Irwin King
Findings of the Association for Computational Linguistics: ACL 2026
Zhang He | Wenqian Cui | Haoning Xu | Xiao-Hui Li | Lei Zhu | Haoli Bai | Ma Shaohua | Irwin King
Findings of the Association for Computational Linguistics: ACL 2026
Full-Duplex Speech Language Models (FD-SLMs) enable real-time, overlapping conversational interactions, offering a more dynamic user experience compared to traditional half-duplex models. However, existing benchmarks primarily focus on evaluating single-round interactions, neglecting the complexities of multi-round communication. Evaluating FD-SLMs in multi-round settings poses significant challenges, including blurred turn boundaries in communication and context inconsistency during model inference. Also, existing benchmarks often focus solely on evaluating conversational features, neglecting other critical aspects. To address these gaps, we introduce MTR-DuplexBench, a novel benchmark designed for a comprehensive multi-round evaluation of FD-SLMs. MTR-DuplexBench not only segments continuous full-duplex dialogues into discrete turns for turn-by-turn assessment but also incorporates various evaluation aspects, including conversational features, dialogue quality, instruction following, and safety. Experimental results reveal that current FD-SLMs face difficulties in maintaining consistent performance across multiple rounds and evaluation dimensions, highlighting the necessity and effectiveness of our benchmark.
UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusion
Zhaoqing Li | Haoning Xu | Jingran Su | Yaofang Liu | Zhefan Rao | Huimeng Wang | Jiajun Deng | Tianzi Wang | Zengrui Jin | Rui Liu | Haoxuan Che | Xunying Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zhaoqing Li | Haoning Xu | Jingran Su | Yaofang Liu | Zhefan Rao | Huimeng Wang | Jiajun Deng | Tianzi Wang | Zengrui Jin | Rui Liu | Haoxuan Che | Xunying Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
We present UNISON, a latent flow-matching framework that unifies speech generation, sound generation, and audio editing within a single model. A single model handles text-to-audio, text-to-speech, zero-shot speaker cloning, mixed speech-and-sound generation, scene-level audio editing, speech-in-scene editing, and timed audio composition, all of which share a single set of weights. Our architecture features two core designs: (1) Layer-wise deep LLM fusion, which injects hidden states from uniformly sampled layers of a frozen MLLM into corresponding MM-DiT blocks via learned projections, providing depth-varying semantic conditioning. This configuration achieves better T2A FD and CLAP than a persistent penultimate-layer conditioning baseline; and (2) a unified multi-task architecture where task identity is encoded solely by a channel-wise mask and source audio is provided through VAE-encoded channel concatenation. Training is stabilized by an online GPU-side multi-task data synthesis pipeline with task-homogeneous batching and a two-stage curriculum. With 621M–732M trainable generative parameters, UNISON achieves competitive results across the evaluated domains. Its trainable generative backbone uses 1.8–4.9x fewer parameters than the closest unified systems considered, while deployment additionally requires a frozen 7B text encoder. Audio samples and source code are publicly available.