M-SENA: An Integrated Platform for Multimodal Sentiment Analysis

Huisheng Mao, Ziqi Yuan, Hua Xu, Wenmeng Yu, Yihe Liu, Kai Gao


Abstract
M-SENA is an open-sourced platform for Multimodal Sentiment Analysis. It aims to facilitate advanced research by providing flexible toolkits, reliable benchmarks, and intuitive demonstrations. The platform features a fully modular video sentiment analysis framework consisting of data management, feature extraction, model training, and result analysis modules. In this paper, we first illustrate the overall architecture of the M-SENA platform and then introduce features of the core modules. Reliable baseline results of different modality features and MSA benchmarks are also reported. Moreover, we use model evaluation and analysis tools provided by M-SENA to present intermediate representation visualization, on-the-fly instance test, and generalization ability test results. The source code of the platform is publicly available at https://github.com/thuiar/M-SENA.
Anthology ID:
2022.acl-demo.20
Volume:
Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations
Month:
May
Year:
2022
Address:
Dublin, Ireland
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
204–213
Language:
URL:
https://aclanthology.org/2022.acl-demo.20
DOI:
10.18653/v1/2022.acl-demo.20
Bibkey:
Cite (ACL):
Huisheng Mao, Ziqi Yuan, Hua Xu, Wenmeng Yu, Yihe Liu, and Kai Gao. 2022. M-SENA: An Integrated Platform for Multimodal Sentiment Analysis. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 204–213, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
M-SENA: An Integrated Platform for Multimodal Sentiment Analysis (Mao et al., ACL 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.acl-demo.20.pdf
Code
 thuiar/MMSA +  additional community code
Data
CH-SIMSCMU-MOSEIMultimodal Opinionlevel Sentiment Intensity