StudEmo: A Non-aggregated Review Dataset for Personalized Emotion Recognition

Anh Ngo, Agri Candri, Teddy Ferdinan, Jan Kocon, Wojciech Korczynski


Abstract
Humans’ emotional perception is subjective by nature, in which each individual could express different emotions regarding the same textual content. Existing datasets for emotion analysis commonly depend on a single ground truth per data sample, derived from majority voting or averaging the opinions of all annotators. In this paper, we introduce a new non-aggregated dataset, namely StudEmo, that contains 5,182 customer reviews, each annotated by 25 people with intensities of eight emotions from Plutchik’s model, extended with valence and arousal. We also propose three personalized models that use not only textual content but also the individual human perspective, providing the model with different approaches to learning human representations. The experiments were carried out as a multitask classification on two datasets: our StudEmo dataset and GoEmotions dataset, which contains 28 emotional categories. The proposed personalized methods significantly improve prediction results, especially for emotions that have low inter-annotator agreement.
Anthology ID:
2022.nlperspectives-1.7
Volume:
Proceedings of the 1st Workshop on Perspectivist Approaches to NLP @LREC2022
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Gavin Abercrombie, Valerio Basile, Sara Tonelli, Verena Rieser, Alexandra Uma
Venue:
NLPerspectives
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
46–55
Language:
URL:
https://aclanthology.org/2022.nlperspectives-1.7
DOI:
Bibkey:
Cite (ACL):
Anh Ngo, Agri Candri, Teddy Ferdinan, Jan Kocon, and Wojciech Korczynski. 2022. StudEmo: A Non-aggregated Review Dataset for Personalized Emotion Recognition. In Proceedings of the 1st Workshop on Perspectivist Approaches to NLP @LREC2022, pages 46–55, Marseille, France. European Language Resources Association.
Cite (Informal):
StudEmo: A Non-aggregated Review Dataset for Personalized Emotion Recognition (Ngo et al., NLPerspectives 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.nlperspectives-1.7.pdf
Data
GoEmotions