Wenjun Huang
Author directory2026
LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
Yezi Liu | Hanning Chen | Wenjun Huang | Yang Ni | Mohsen Imani
Findings of the Association for Computational Linguistics: ACL 2026
Yezi Liu | Hanning Chen | Wenjun Huang | Yang Ni | Mohsen Imani
Findings of the Association for Computational Linguistics: ACL 2026
Large Language Models (LLMs) encode vast factual knowledge, yet their inability to selectively forget specific information hinders privacy protection, bias mitigation, and post-deployment correction. We present LoRA-based Unlearning with Negative Examples (LUNE), a lightweight framework that performs negative-only unlearning by updating only low-rank adapters while freezing the backbone, thereby localizing edits and avoiding disruptive global changes. Leveraging Low-Rank Adaptation (LoRA), LUNE targets intermediate representations to suppress (or replace) requested knowledge with an order-of-magnitude lower compute and memory than full fine-tuning or direct weight editing. Extensive experiments on multiple factual unlearning tasks show that LUNE: (I) achieves effectiveness comparable to full fine-tuning and memory-editing methods; and (II) reduces computational cost by about an order of magnitude.
Music Audio-Visual Question Answering Requires Specialized Multimodal Designs
Wenhao You | Xingjian Diao | Wenjun Huang | Chunhui Zhang | Keyi Kong | Weiyi Wu | Chiyu Ma | Zhongyu Ouyang | Tingxuan Wu | Ming Cheng | Soroush Vosoughi | Jiang Gui
Findings of the Association for Computational Linguistics: ACL 2026
Wenhao You | Xingjian Diao | Wenjun Huang | Chunhui Zhang | Keyi Kong | Weiyi Wu | Chiyu Ma | Zhongyu Ouyang | Tingxuan Wu | Ming Cheng | Soroush Vosoughi | Jiang Gui
Findings of the Association for Computational Linguistics: ACL 2026
While recent Multimodal Large Language Models exhibit impressive capabilities for general multimodal tasks, specialized domains like music necessitate tailored approaches. Music Audio-Visual Question Answering (Music AVQA) particularly underscores this, presenting unique challenges with its continuous, densely layered audio-visual content, intricate temporal dynamics, and the critical need for domain-specific knowledge. Through a systematic analysis of Music AVQA datasets and methods, this paper identifies that specialized input processing, architectures incorporating dedicated spatial-temporal designs, and music-specific modeling strategies are critical for success in this domain. Our study provides valuable insights for researchers by highlighting effective design patterns empirically linked to strong performance, proposing concrete future directions for incorporating musical priors, and aiming to establish a robust foundation for advancing multimodal musical understanding. We aim to encourage further research in this area and provide a GitHub repository of relevant works: https://github.com/WenhaoYou1/Survey4MusicAVQA.
DemMA: Dementia Multi-Turn Dialogue Agent with Expert-Guided Reasoning and Action Simulation
Yutong Song | Jiang Wu | Kazi Shaharair Sharif | Pengfei Zhang | Wenjun Huang | Honghui Xu | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: ACL 2026
Yutong Song | Jiang Wu | Kazi Shaharair Sharif | Pengfei Zhang | Wenjun Huang | Honghui Xu | Nikil Dutt | Amir M. Rahmani
Findings of the Association for Computational Linguistics: ACL 2026
Simulating dementia patients with large language models (LLMs) is challenging due to the need to jointly model cognitive impairment, emotional dynamics, and nonverbal behaviors over long conversations. We present DemMA, an expert-guided dementia dialogue agent for high-fidelity multi-turn patient simulation. DemMA constructs clinically grounded dementia personas by integrating pathology information, personality traits, and subtype-specific memory-status personas informed by clinical experts. To move beyond text-only simulation, DemMA explicitly models nonverbal behaviors, including motion, facial expressions, and vocal cues. We further introduce a Chain-of-Thought distillation framework that trains a single LLM to jointly generate reasoning traces, patient utterances, and aligned behavioral actions within one forward pass, enabling efficient deployment without multi-agent inference.
AP-GRPO: Anchor-Gated Phonetic Alignment with Policy Optimization for Pathological Speech Reconstruction
Pengfei Zhang | Hoang H Nguyen | Yutong Song | Wenjun Huang | Tahmid Imtiaz Imu | Henry Peng Zou | Jiang Wu | Honghui Xu | Amir M. Rahmani
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Pengfei Zhang | Hoang H Nguyen | Yutong Song | Wenjun Huang | Tahmid Imtiaz Imu | Henry Peng Zou | Jiang Wu | Honghui Xu | Amir M. Rahmani
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Pathological speech from patients with neurodegenerative and neuromotor disorders is often acoustically distorted and linguistically fragmented, making pathological speech reconstruction necessary to recover intended textual content from distorted and incomplete speech recordings. Crucially, such recordings are rarely uniformly degraded: some words or short phrases remain reliable and can serve as audible anchors for reconstructing the corrupted surrounding content. We introduce **Anchor-gated Phonetic Group Relative Policy Optimization (AP-GRPO)**, a GRPO framework with phonetic reward that aligns speech language models (SLMs) through audible-anchor preservation and inter-anchor phonetic compatibility to the original speech signal. AP-GRPO consists of: (i) an **anchor-gated reward** that matches reliable audible anchors in clear regions; and (ii) an **inter-anchor phonetic alignment reward** that evaluates whether recovered contents are phonetically supported by the corresponding corrupted inter-anchor speech span. Across four disease conditions, AP-GRPO improves faithful speech reconstruction, and the learned anchor constraint automatically adapts to each condition and thus reveals interpretable disease-specific profiles: conditions with severe articulatory degradation require stronger anchor enforcement, whereas milder impairment or linguistically impaired conditions rely more on phonetic alignment for inter-anchor recovery.