Jiayang Xu
Author directory2026
Audio Editing in the Era of Foundation Models: A Survey
Changhao Pan | YiFei Fan | Fan Zhuo | Yifu Chen | Wenxiang Guo | Yu Zhang | Zhiyuan Zhu | Rui Yang | Shengpeng Ji | Chenyuhao Wen | Jiayang Xu | Ke Lei | Xiaoda Yang | Jingyu Lu | Zhou Zhao
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Changhao Pan | YiFei Fan | Fan Zhuo | Yifu Chen | Wenxiang Guo | Yu Zhang | Zhiyuan Zhu | Rui Yang | Shengpeng Ji | Chenyuhao Wen | Jiayang Xu | Ke Lei | Xiaoda Yang | Jingyu Lu | Zhou Zhao
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Audio editing aims to modify a given synthetic or real-world audio signal to satisfy specific user needs. As a promising yet challenging direction in AIGC, it has attracted increasing attention. Recent advances in audio generation have made powerful generative models central to modern audio editing systems. This rapid progress has created a growing need to organize emerging tasks, methods, and resources into a coherent view. In this survey, we provide a comprehensive review of audio editing in the era of foundation models. We first present a unified taxonomy of existing editing tasks and then summarize the major foundation-model paradigms that support modern audio editing, covering representative approaches from both training-based and training-free perspectives. We further discuss related resources, including datasets, evaluation protocols, and data construction tools. Finally, we identify open challenges in this field and outline promising directions for future research. The accompanying repository is released at https://github.com/MM-Speech/AudioEditSurvey.
2025
Memory-QA: Answering Recall Questions Based on Multimodal Memories
Hongda Jiang | Xinyuan Zhang | Siddhant Garg | Rishab Arora | Shiun-Zu Kuo | Jiayang Xu | Aaron Colak | Xin Luna Dong
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Hongda Jiang | Xinyuan Zhang | Siddhant Garg | Rishab Arora | Shiun-Zu Kuo | Jiayang Xu | Aaron Colak | Xin Luna Dong
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
We introduce Memory-QA, a novel real-world task that involves answering recall questions about visual content from previously stored multimodal memories. This task poses unique challenges, including the creation of task-oriented memories, the effective utilization of temporal and location information within memories, and the ability to draw upon multiple memories to answer a recall question. To address these challenges, we propose a comprehensive pipeline, Pensieve, integrating memory-specific augmentation, time- and location-aware multi-signal retrieval, and multi-memory QA fine-tuning. We created a multimodal benchmark to illustrate various real challenges in this task, and show the superior performance of Pensieve over state-of-the-art solutions (up to +14% on QA accuracy).