State-Anchored Complete-View Distillation for Robust Conversational Multimodal Emotion Recognition

Zhaoyan Pan, Xiangdong Li, Wenke Wu, Mengting Ma, Ye Lou, Ji Zhou, Jiatong Pan, Wei Zhang


Abstract
Conversational multimodal emotion recognition MER requires reliable prediction when language acoustic or visual observations are missing or unreliable. Many missing-modality methods reconstruct absent inputs yet such recovery can be non-unique in dialogue context and nonverbal cues may conflict with the target utterance. To this end we propose CoRe-KD Complete-view Reference-guided Knowledge Distillation a state-anchored conflict-regularized complete-view distillation framework for robust conversational MER. A complete-view teacher provides structured references including prediction-level references fused states and modality-specific states. Complete-view State Anchoring CSA aligns incomplete-view student predictions and states with these references while Nonverbal Conflict Exposure NCE trains on target-preserving nonverbal conflict views to reduce donor-label bias. Experiments on IEMOCAP and MELD with CMU-MOSEI as a supplementary utterance-level check show consistent gains under fixed- and random-missing protocols. Comprehensive ablation studies and further analyses support the role of CSA and the complementary effect of NCE.
Anthology ID:
2026.aacl-long.76
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1663–1687
Language:
URL:
https://aclanthology.org/2026.aacl-long.76/
DOI:
Bibkey:
Cite (ACL):
Zhaoyan Pan, Xiangdong Li, Wenke Wu, Mengting Ma, Ye Lou, Ji Zhou, Jiatong Pan, and Wei Zhang. 2026. State-Anchored Complete-View Distillation for Robust Conversational Multimodal Emotion Recognition. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1663–1687, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
State-Anchored Complete-View Distillation for Robust Conversational Multimodal Emotion Recognition (Pan et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.76.pdf