Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis

Yewon Hwang, Jong-Hwan Kim


Abstract
While multimodal sentiment analysis (MSA) has gained much attention over the last few years, the main focus of most work on MSA has been limited to constructing multimodal representations that capture interactions between different modalities in a single task. This was largely due to a lack of unimodal annotations in MSA benchmark datasets. However, training a model using only multimodal representations can lead to suboptimal performance due to insufficient learning of each uni-modal representation. In this work, to fully optimize learning representations from multimodal data, we propose SUGRM which jointly trains multimodal and unimodal tasks using recalibrated features. The features are recalibrated such that the model learns to weight the features differently based on the features of other modalities. Further, to leverage unimodal tasks, we auto-generate unimodal annotations via a unimodal label generation module (ULGM). The experiment results on two benchmark datasets demonstrate the efficacy of our framework.
Anthology ID:
2023.findings-eacl.2
Volume:
Findings of the Association for Computational Linguistics: EACL 2023
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
35–46
Language:
URL:
https://aclanthology.org/2023.findings-eacl.2
DOI:
10.18653/v1/2023.findings-eacl.2
Bibkey:
Cite (ACL):
Yewon Hwang and Jong-Hwan Kim. 2023. Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis. In Findings of the Association for Computational Linguistics: EACL 2023, pages 35–46, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Self-Supervised Unimodal Label Generation Strategy Using Recalibrated Modality Representations for Multimodal Sentiment Analysis (Hwang & Kim, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-eacl.2.pdf
Video:
 https://aclanthology.org/2023.findings-eacl.2.mp4