LyS at SemEval-2024 Task 3: An Early Prototype for End-to-End Multimodal Emotion Linking as Graph-Based Parsing

Ana Ezquerro, David Vilares


Abstract
This paper describes our participation in SemEval 2024 Task 3, which focused on Multimodal Emotion Cause Analysis in Conversations. We developed an early prototype for an end-to-end system that uses graph-based methods from dependency parsing to identify causal emotion relations in multi-party conversations. Our model comprises a neural transformer-based encoder for contextualizing multimodal conversation data and a graph-based decoder for generating the adjacency matrix scores of the causal graph. We ranked 7th out of 15 valid and official submissions for Subtask 1, using textual inputs only. We also discuss our participation in Subtask 2 during post-evaluation using multi-modal inputs.
Anthology ID:
2024.semeval-1.182
Volume:
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Harish Tayyar Madabushi, Giovanni Da San Martino, Sara Rosenthal, Aiala Rosá
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1252–1259
Language:
URL:
https://aclanthology.org/2024.semeval-1.182
DOI:
10.18653/v1/2024.semeval-1.182
Bibkey:
Cite (ACL):
Ana Ezquerro and David Vilares. 2024. LyS at SemEval-2024 Task 3: An Early Prototype for End-to-End Multimodal Emotion Linking as Graph-Based Parsing. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 1252–1259, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
LyS at SemEval-2024 Task 3: An Early Prototype for End-to-End Multimodal Emotion Linking as Graph-Based Parsing (Ezquerro & Vilares, SemEval 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.semeval-1.182.pdf
Supplementary material:
 2024.semeval-1.182.SupplementaryMaterial.txt
Supplementary material:
 2024.semeval-1.182.SupplementaryMaterial.tex