Findings of the WASSA 2024 EXALT shared task on Explainability for Cross-Lingual Emotion in Tweets

Aaron Maladry, Pranaydeep Singh, Els Lefever


Abstract
This paper presents a detailed description and results of the first shared task on explainability for cross-lingual emotion in tweets. Given a tweet in one of the five target languages (Dutch, Russian, Spanish, English, and French), systems should predict the correct emotion label (Task 1), as well as the words triggering the predicted emotion label (Task 2). The tweets were collected based on a list of stop words to prevent topical or emotional bias and were subsequently manually annotated. For both tasks, only a training corpus for English was provided, obliging participating systems to design cross-lingual approaches. Our shared task received submissions from 14 teams for the emotion detection task and from 6 teams for the trigger word detection task. The highest macro F1-scores obtained for both tasks are respectively 0.629 and 0.616, demonstrating that cross-lingual emotion detection is still a challenging task.
Anthology ID:
2024.wassa-1.43
Volume:
Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Orphée De Clercq, Valentin Barriere, Jeremy Barnes, Roman Klinger, João Sedoc, Shabnam Tafreshi
Venues:
WASSA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
454–463
Language:
URL:
https://aclanthology.org/2024.wassa-1.43
DOI:
10.18653/v1/2024.wassa-1.43
Bibkey:
Cite (ACL):
Aaron Maladry, Pranaydeep Singh, and Els Lefever. 2024. Findings of the WASSA 2024 EXALT shared task on Explainability for Cross-Lingual Emotion in Tweets. In Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, pages 454–463, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Findings of the WASSA 2024 EXALT shared task on Explainability for Cross-Lingual Emotion in Tweets (Maladry et al., WASSA-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.wassa-1.43.pdf