UMUTeam at SemEval-2024 Task 10: Discovering and Reasoning about Emotions in Conversation using Transformers

Ronghao Pan, José Antonio García-díaz, Diego Roldán, Rafael Valencia-garcía


Abstract
These notes describe the participation of the UMUTeam in EDiReF, the 10th shared task of SemEval 2024. The goal is to develop systems for detecting and inferring emotional changes in the conversation. The task was divided into three related subtasks: (i) Emotion Recognition in Conversation (ERC) in Hindi-English code-mixed conversations, (ii) Emotion Flip Reasoning (EFR) in Hindi-English code-mixed conversations, and (iii) EFR in English conversations. We were involved in all three and our approach is based on a fine-tuning approach with different pre-trained models. After evaluation, we found BERT to be the best model for ERC and EFR and with this model we achieved the thirteenth best result with an F1 score of 43% in Subtask 1, the sixth best in Subtask 2 with an F1 score of 26% and the fifteenth best in Subtask 3 with an F1 score of 22%.
Anthology ID:
2024.semeval-1.101
Volume:
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Harish Tayyar Madabushi, Giovanni Da San Martino, Sara Rosenthal, Aiala Rosá
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
703–709
Language:
URL:
https://aclanthology.org/2024.semeval-1.101
DOI:
10.18653/v1/2024.semeval-1.101
Bibkey:
Cite (ACL):
Ronghao Pan, José Antonio García-díaz, Diego Roldán, and Rafael Valencia-garcía. 2024. UMUTeam at SemEval-2024 Task 10: Discovering and Reasoning about Emotions in Conversation using Transformers. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 703–709, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
UMUTeam at SemEval-2024 Task 10: Discovering and Reasoning about Emotions in Conversation using Transformers (Pan et al., SemEval 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.semeval-1.101.pdf
Supplementary material:
 2024.semeval-1.101.SupplementaryMaterial.txt
Supplementary material:
 2024.semeval-1.101.SupplementaryMaterial.zip