HyDRA: Hyperbolic Damage-aware Recovery and Adaptation for Robust Multimodal Sentiment Analysis with Incomplete Data

Yun Luo, Zejiang He, Zhen Huang, Zhiliang Tian, Yanzhou Ma, Menglong Lu, Jingyuan Huang, Shanshan Liu, Faying Wu, Dongsheng Li


Abstract
Incomplete-Modality Multimodal Sentiment Analysis extends multimodal sentiment analysis (MSA) to infer sentiment from language, audio, and visual streams when one or more modalities are incomplete at inference time. Existing methods improve incomplete-modality MSA through feature reconstruction, distillation, or fusion adjustment, but usually assign similar correction strength to all samples with incomplete inputs. This overlooks the uneven emotional impact of modality missingness: mild missingness often leaves sentiment recognizable, whereas severe missingness can distort the expressed emotion and therefore requires stronger correction. We propose HyDRA (Hyperbolic Damage-aware Recovery and Adaptation), a damage-aware and text-guided hyperbolic framework that aligns correction strength with missingness-induced sentiment damage. HyDRA first recovers lost emotional cues from available modalities, then places each sample in the Poincaré ball according to estimated damage severity, and finally applies damage-weighted hyperbolic correction toward a complete-modality teacher anchor. Since hyperbolic distances expand near the boundary, heavily incomplete samples receive stronger correction while lightly incomplete samples are gently adjusted. Experiments on MOSI, MOSEI, and SIMS show SOTA robustness across incomplete-modality conditions.
Anthology ID:
2026.emnlp-main.2492
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
56575–56603
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2492/
DOI:
Bibkey:
Cite (ACL):
Yun Luo, Zejiang He, Zhen Huang, Zhiliang Tian, Yanzhou Ma, Menglong Lu, Jingyuan Huang, Shanshan Liu, Faying Wu, and Dongsheng Li. 2026. HyDRA: Hyperbolic Damage-aware Recovery and Adaptation for Robust Multimodal Sentiment Analysis with Incomplete Data. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 56575–56603, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
HyDRA: Hyperbolic Damage-aware Recovery and Adaptation for Robust Multimodal Sentiment Analysis with Incomplete Data (Luo et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2492.pdf