Zhiqiang Wang
Author directoryOther people with similar names: Zhiqiang Wang, Zhiqiang Wang
Unverified author pages with similar names: Zhiqiang Wang
2026
Forgetting Across Modalities: Unlearning in Multimodal Large Language Models
Yan Li | Xingrui Yu | Zhiqiang Wang | Zhenyi Wang | Ivor Tsang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yan Li | Xingrui Yu | Zhiqiang Wang | Zhenyi Wang | Ivor Tsang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Gradient conflict between forgetting and retaining objectives is a well-known obstacle in machine unlearning, where opposing gradients on shared parameters cause destructive interference. In Multimodal Large Language Models (MLLMs), cross-modal coupling entangles visual and textual representations within the same parameters, making this conflict considerably more severe. We propose EASE (Efficient Alignment-aware Selective Erasing), which explicitly balances the conflicting gradient directions. EASE first dynamically locates the conflicting parameters at each step by detecting opposite-sign gradients, then performs a manifold-constrained optimization within the two-dimensional subspace spanned by the task gradients to find the linear combination that maximally aligns them, yielding a valid descent direction for both objectives without any manually tuned trade-off coefficient. Nonconflicting parameters keep their standard updates, keeping the method lightweight. Experiments across multiple MLLM architectures and unlearning benchmarks show that EASE achieves superior unlearning efficiency and faster convergence while matching or surpassing existing methods in multimodal quality.