SocialNLP 2018 EmotionX Challenge Overview: Recognizing Emotions in Dialogues

Chao-Chun Hsu, Lun-Wei Ku


Abstract
This paper describes an overview of the Dialogue Emotion Recognition Challenge, EmotionX, at the Sixth SocialNLP Workshop, which recognizes the emotion of each utterance in dialogues. This challenge offers the EmotionLines dataset as the experimental materials. The EmotionLines dataset contains conversations from Friends TV show transcripts (Friends) and real chatting logs (EmotionPush), where every dialogue utterance is labeled with emotions. Organizers provide baseline results. 18 teams registered in this challenge and 5 of them submitted their results successfully. The best team achieves the unweighted accuracy 62.48 and 62.5 on EmotionPush and Friends, respectively. In this paper we present the task definition, test collection, the evaluation results of the groups that participated in this challenge, and their approach.
Anthology ID:
W18-3505
Volume:
Proceedings of the Sixth International Workshop on Natural Language Processing for Social Media
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Lun-Wei Ku, Cheng-Te Li
Venue:
SocialNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
27–31
Language:
URL:
https://aclanthology.org/W18-3505
DOI:
10.18653/v1/W18-3505
Bibkey:
Cite (ACL):
Chao-Chun Hsu and Lun-Wei Ku. 2018. SocialNLP 2018 EmotionX Challenge Overview: Recognizing Emotions in Dialogues. In Proceedings of the Sixth International Workshop on Natural Language Processing for Social Media, pages 27–31, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
SocialNLP 2018 EmotionX Challenge Overview: Recognizing Emotions in Dialogues (Hsu & Ku, SocialNLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-3505.pdf
Data
EmotionLines