Chenyuhao Wen
Author directory2026
One-Stage Multi-Task Instruction-Guided 3D Spatial Audio Editing
Ke Lei | Chenyuhao Wen | Yu Zhang | Wenxiang Guo | Changhao Pan | Sashuai Zhou | Yongshi Li | Ruiqi Li | Ruofan Hu | Haorui Xu | Xiang Yin | Zhou Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Ke Lei | Chenyuhao Wen | Yu Zhang | Wenxiang Guo | Changhao Pan | Sashuai Zhou | Yongshi Li | Ruiqi Li | Ruofan Hu | Haorui Xu | Xiang Yin | Zhou Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Spatial audio editing modifies an existing soundfield according to a user’s instruction while preserving the rest of the scene. Unlike conventional audio editing, it must reason jointly about audio events, spatial information, dynamic changes, and environmental information in first-order Ambisonic (FOA) waveforms. Existing language-guided editors mainly target conventional audio or rely on sequential operations, and therefore do not directly support one-stage editing for complex 3D spatial instructions. We present SwanWeave, the first one-stage multi-task framework for instruction-guided 3D FOA spatial audio editing. We build paired FOA supervision from open-source speech and sound-effect corpora using controllable room simulation, covering more than ten single-operation and compound tasks across the four editing axes. To handle this heterogeneous edit space, SwanWeave uses Spatial Edit Mixture-of-Experts (SE-MoE) with dual-level routing, selecting task-aware expert combinations for compound instructions and frame-level routed/null experts for local edit decisions. We further introduce Spatial Preference Optimization (SPO), a Direct Preference Optimization (DPO)-based alignment objective with edit-specific negative targets, and adopt staged training to improve natural-language grounding. Experiments show that SwanWeave achieves better editing quality than existing general audio editors and spatial audio baselines across all tasks. Spatial audio editing demos can be found at https://swanaigc.github.io/#swanweave, code can be found at: https://github.com/MM-Speech/SwanWeave.
Comprehensive Benchmarking of Long-Form Speech Generation in Diverse Scenarios
Changhao Pan | Rui Yang | Han Wang | Zhuan Zhou | Xuming He | Wenxiang Guo | Ziyue Jiang | Ruiqi Li | Yu Zhang | Chenyuhao Wen | Ke Lei | Xiang Yin | Jingyu Lu | Zhiyuan Zhu | Zhou Zhao
Findings of the Association for Computational Linguistics: ACL 2026
Changhao Pan | Rui Yang | Han Wang | Zhuan Zhou | Xuming He | Wenxiang Guo | Ziyue Jiang | Ruiqi Li | Yu Zhang | Chenyuhao Wen | Ke Lei | Xiang Yin | Jingyu Lu | Zhiyuan Zhu | Zhou Zhao
Findings of the Association for Computational Linguistics: ACL 2026
Recent advances in speech generation have enabled high-fidelity synthesis, yet systematic evaluation of models under long-context conditions remains largely underexplored. A comprehensive evaluation benchmark for long-form speech is indispensable for two reasons: 1) existing test scenarios are often confined to limited domains, creating a significant gap with the diverse downstream applications; 2) existing metrics overlook critical long-text factors such as consistency and coherence, failing to generalize reliably. To this end, we propose LFSBench, a comprehensive benchmark that decomposes “long-form speech quality” into specific, disentangled dimensions. LFSBench has three key properties. 1) Rich speech scenarios: Focusing on long-form speech generation and multi-speaker dialog generation, LFSBench covers acoustics, semantics, and expressiveness challenges, and consists of 1,101 samples spanning 17 common speech scenarios; 2) Comprehensive evaluation dimensions: Along the acoustics, semantics, and expressiveness axes, LFSBench defines an automated evaluation protocol with seven metrics to provide a comprehensive, accurate, and standardized assessment; 3) Valuable Insights: Through extensive experiments, we reveal that current models still struggle in highly expressive scenarios and exhibit a notable gap in consistency and hierarchy compared to real recordings.
Audio Editing in the Era of Foundation Models: A Survey
Changhao Pan | YiFei Fan | Fan Zhuo | Yifu Chen | Wenxiang Guo | Yu Zhang | Zhiyuan Zhu | Rui Yang | Shengpeng Ji | Chenyuhao Wen | Jiayang Xu | Ke Lei | Xiaoda Yang | Jingyu Lu | Zhou Zhao
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Changhao Pan | YiFei Fan | Fan Zhuo | Yifu Chen | Wenxiang Guo | Yu Zhang | Zhiyuan Zhu | Rui Yang | Shengpeng Ji | Chenyuhao Wen | Jiayang Xu | Ke Lei | Xiaoda Yang | Jingyu Lu | Zhou Zhao
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Audio editing aims to modify a given synthetic or real-world audio signal to satisfy specific user needs. As a promising yet challenging direction in AIGC, it has attracted increasing attention. Recent advances in audio generation have made powerful generative models central to modern audio editing systems. This rapid progress has created a growing need to organize emerging tasks, methods, and resources into a coherent view. In this survey, we provide a comprehensive review of audio editing in the era of foundation models. We first present a unified taxonomy of existing editing tasks and then summarize the major foundation-model paradigms that support modern audio editing, covering representative approaches from both training-based and training-free perspectives. We further discuss related resources, including datasets, evaluation protocols, and data construction tools. Finally, we identify open challenges in this field and outline promising directions for future research. The accompanying repository is released at https://github.com/MM-Speech/AudioEditSurvey.
Speaking While Listening: A Survey and Empirical Audit of Full-Duplex Spoken Dialogue Systems
Jingyu Lu | Yuhan Wang | Jianming Luo | Yifu Chen | Tianle Liang | Shengpeng Ji | Ziyue Jiang | Xiaoda Yang | Yu Zhang | Xize Cheng | Chenyuhao Wen | Changhao Pan | Haoxiao Wang | Chen Ye | Jian Wu | Xiaoxi Jiang | Guanjun Jiang | Zhou Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jingyu Lu | Yuhan Wang | Jianming Luo | Yifu Chen | Tianle Liang | Shengpeng Ji | Ziyue Jiang | Xiaoda Yang | Yu Zhang | Xize Cheng | Chenyuhao Wen | Changhao Pan | Haoxiao Wang | Chen Ye | Jian Wu | Xiaoxi Jiang | Guanjun Jiang | Zhou Zhao
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
More than a dozen spoken dialogue systems have recently claimed to be "full-duplex," yet the term has been used to describe substantially different capabilities. Existing surveys collapse them onto a single axis (cascaded/end-to-end, or engineered/learned) and miss the distinctions that matter most for builders. We argue that much of this ambiguity is taxonomical: current terminology does not specify where duplex decisions are made, which interaction types are supported, or how a system behaves moment by moment. This paper introduces three complementary frameworks: (i) an L,0-L,3 Architectural Hierarchy that locates where duplex decisions are made; (ii) a T x Ix R Interaction Ontology that specifies the temporal relation, user intent, and required system response for each interaction; and (i) a Decision State Machine(LDLE/LISTEN/SPEAK/WAIT/DUAL) that describes how systems move between states.Across published systems and benchmarks, our audit reveals a realization gap: although many architectures can in principle operate in full-duplex states, their observed behavior remains constrained by the interaction patterns represented in training and evaluation.We identify the open-source-versus-industrial data gap, as well as the still-unrealized goal of L3 representation-level modeling, as key frontiers for future research on full-duplex dialogue. The related material is available at https://github.com/MM-Speech/DuplexSurvey.
SDiaReward: Modeling and Benchmarking Spoken Dialogue Rewards with Modality and Colloquialness
Jingyu Lu | Yuhan Wang | Fan Zhuo | Xize Cheng | Changhao Pan | Xueyi Pu | Yifu Chen | Chenyuhao Wen | Tianle Liang | Zhou Zhao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Jingyu Lu | Yuhan Wang | Fan Zhuo | Xize Cheng | Changhao Pan | Xueyi Pu | Yifu Chen | Chenyuhao Wen | Tianle Liang | Zhou Zhao
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The rapid evolution of end-to-end spoken dialogue systems demands transcending mere textual semantics to incorporate paralinguistic nuances and the spontaneous nature of human conversation. However, current methods struggle with two critical gaps: the modality gap, involving prosody and emotion, and the colloquialness gap, distinguishing written scripts from natural speech. To address these challenges, we introduce SDiaReward, an end-to-end multi-turn reward model trained on SDiaReward-Dataset, a novel collection of episode-level preference pairs explicitly targeting these gaps. It operates directly on full multi-turn speech episodes and is optimized with pairwise preference supervision, enabling joint assessment of modality and colloquialness in a single evaluator. We further establish ESDR-Bench, a stratified benchmark for robust episode-level evaluation. Experiments demonstrate that SDiaReward achieves state-of-the-art pairwise preference accuracy, significantly outperforming general-purpose audio LLMs. Further analysis suggests that SDiaReward captures relative conversational expressiveness beyond superficial synthesis cues, improving generalization across domains and recording conditions.
Search
Fix author
Co-authors
- Changhao Pan 5
- Zhou Zhao 5
- Jingyu Lu 4
- Yu Zhang 4
- Yifu Chen 3
- Wenxiang Guo 3
- Ke Lei 3
- Xize Cheng 2
- Shengpeng Ji 2
- Ziyue Jiang 2
- Ruiqi Li 2
- Tianle Liang 2
- Yuhan Wang 2
- Rui Yang 2
- Xiaoda Yang 2
- Xiang Yin 2
- Zhiyuan Zhu 2
- Fan Zhuo 2
- YiFei Fan 1
- Xuming He 1
- Ruofan Hu 1
- Guanjun Jiang 1
- Xiaoxi Jiang 1
- Yongshi Li 1
- Jianming Luo 1
- Xueyi Pu 1
- Han Wang 1
- Haoxiao Wang 1
- Jian Wu 1
- Haorui Xu 1
- Jiayang Xu 1
- Chen Ye 1
- Sashuai Zhou 1
- Zhuan Zhou 1