QFNU_CS at SemEval-2024 Task 3: A Hybrid Pre-trained Model based Approach for Multimodal Emotion-Cause Pair Extraction Task

Zining Wang, Yanchao Zhao, Guanghui Han, Yang Song


Abstract
This article presents the solution of Qufu Normal University for the Multimodal Sentiment Cause Analysis competition in SemEval2024 Task 3.The competition aims to extract emotion-cause pairs from dialogues containing text, audio, and video modalities. To cope with this task, we employ a hybrid pre-train model based approach. Specifically, we first extract and fusion features from dialogues based on BERT, BiLSTM, openSMILE and C3D. Then, we adopt BiLSTM and Transformer to extract the candidate emotion-cause pairs. Finally, we design a filter to identify the correct emotion-cause pairs. The evaluation results show that, we achieve a weighted average F1 score of 0.1786 and an F1 score of 0.1882 on CodaLab.
Anthology ID:
2024.semeval-1.53
Volume:
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Harish Tayyar Madabushi, Giovanni Da San Martino, Sara Rosenthal, Aiala Rosá
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
349–353
Language:
URL:
https://aclanthology.org/2024.semeval-1.53
DOI:
10.18653/v1/2024.semeval-1.53
Bibkey:
Cite (ACL):
Zining Wang, Yanchao Zhao, Guanghui Han, and Yang Song. 2024. QFNU_CS at SemEval-2024 Task 3: A Hybrid Pre-trained Model based Approach for Multimodal Emotion-Cause Pair Extraction Task. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 349–353, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
QFNU_CS at SemEval-2024 Task 3: A Hybrid Pre-trained Model based Approach for Multimodal Emotion-Cause Pair Extraction Task (Wang et al., SemEval 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.semeval-1.53.pdf
Supplementary material:
 2024.semeval-1.53.SupplementaryMaterial.zip
Supplementary material:
 2024.semeval-1.53.SupplementaryMaterial.txt