Helen Meng
Also published as: Helen M. Meng
Other people with similar names: Helen Meng
2026
Test-Time Adaptation of an Offline Multimodal Foundation Model for Simultaneous Speech Translation
Yi Xing | Manli Yu | Pengfei Liu | Helen Meng
Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026)
Yi Xing | Manli Yu | Pengfei Liu | Helen Meng
Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026)
End-to-end simultaneous speech-to-text translation (SimulST) systems typically rely on complex architectures and sophisticated training strategies. In contrast, we propose a simple approach that combines conventional pause-based segmentation for streaming audio input with a strong off-the-shelf multimodal foundation model adapted at test-time for translation. To achieve simultaneity, we adopt a variant of the classic wait-k read-write policy to control the interaction between audio input and translation output, and use a multi-turn conversation format with response prefilling and key-value caching for coherent translation and computational efficiency. Experiments on the official development sets of the IWSLT 2026 SimulST shared task show that our system achieves a better quality–latency trade-off than the cascaded baseline across all language directions and latency regimes, highlighting the effectiveness of this simple yet powerful approach.
Masked Text-to-Audio Flow-Matching and Reward Feedback Optimization
Rongjie Huang | Dongchao Yang | Wenxiang Guo | Huadai Liu | Xize Cheng | Zehan Wang | Zhou Zhao | Xixin Wu | Helen M. Meng
Findings of the Association for Computational Linguistics: ACL 2026
Rongjie Huang | Dongchao Yang | Wenxiang Guo | Huadai Liu | Xize Cheng | Zehan Wang | Zhou Zhao | Xixin Wu | Helen M. Meng
Findings of the Association for Computational Linguistics: ACL 2026
Flow-matching generative models have created significant milestones in text-to-audio generation, powered by scalable training with increased data, computational resources, and model size, while their scalable inference remains less explored. In this work, we propose MaskAudioFlow, a continuous flow-matching transformer with masked generative modeling designed for scaling text-to-audio inference-time prediction. Specifically, MaskAudioFlow 1) masks spans of audio frames in training and approximates the continuous velocity vector field with flow-matching objective, and 2) performs inference via masked prediction, where we mask out generation and re-predict them through iterative decoding. To reduce the gap between generation and human preferences, we fine-tune MaskAudioFlow using reward signals from text-audio correspondence and perceptual aesthetics. Experimental results demonstrate that MaskAudioFlow achieves state-of-the-art performance in text-to-audio generation, effectively scaling inference-time computation through iterative masked prediction. Moreover, the preference-tuned model demonstrates superior text-audio alignment faithfulness and enhanced perceptual aesthetics. Audio samples are available at https://MaskAudio.github.io
UniSRM: A Unified Speech Reward Model for Reasoning-Based Fine-grained Assessment
Yuanyuan Wang | Dongchao Yang | Yayue Deng | Zhiyong Wu | Steven Y. Guo | Helen M. Meng | Xixin Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yuanyuan Wang | Dongchao Yang | Yayue Deng | Zhiyong Wu | Steven Y. Guo | Helen M. Meng | Xixin Wu
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Evaluating speech generation still relies heavily on human judgments, such as Mean Opinion Score (MOS), which are expensive, subjective, and difficult to reproduce at scale. While a few recent studies have begun to explore AudioLLM-based judge models, existing efforts typically target only a narrow set of scenarios (e.g., utterance-level quality or single-turn dialogue) and provide limited coverage of diverse speech generation tasks and evaluation dimensions. In this work, we propose UniSRM, a unified speech reward model that can support multi-dimensional, interpretable reward signals with reliable reasoning. To support training and evaluation, we introduce UniSRM-Data and UniSRM-Bench, covering speech evaluation tasks from utterance-level quality to context-level coherence. Based on this dataset, we present the unified speech reward model, UniSRM, with a two-stage pipeline that enables reasoning-based fine-grained assessment. Furthermore, we introduce Reasoning-Consistent Rewards to improve the reliability of the reasoning process. Experiments show that UniSRM delivers more reliable and human-aligned judgments across a broad range of speech evaluation tasks, offering a practical foundation for scalable and unified evaluation of speech quality.