Multilingual and Multilabel Emotion Recognition using Virtual Adversarial Training

Vikram Gupta


Abstract
Virtual Adversarial Training (VAT) has been effective in learning robust models under supervised and semi-supervised settings for both computer vision and NLP tasks. However, the efficacy of VAT for multilingual and multilabel emotion recognition has not been explored before. In this work, we explore VAT for multilabel emotion recognition with a focus on leveraging unlabelled data from different languages to improve the model performance. We perform extensive semi-supervised experiments on SemEval2018 multilabel and multilingual emotion recognition dataset and show performance gains of 6.2% (Arabic), 3.8% (Spanish) and 1.8% (English) over supervised learning with same amount of labelled data (10% of training data). We also improve the existing state-of-the-art by 7%, 4.5% and 1% (Jaccard Index) for Spanish, Arabic and English respectively and perform probing experiments for understanding the impact of different layers of the contextual models.
Anthology ID:
2021.mrl-1.7
Volume:
Proceedings of the 1st Workshop on Multilingual Representation Learning
Month:
November
Year:
2021
Address:
Punta Cana, Dominican Republic
Editors:
Duygu Ataman, Alexandra Birch, Alexis Conneau, Orhan Firat, Sebastian Ruder, Gozde Gul Sahin
Venue:
MRL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
74–85
Language:
URL:
https://aclanthology.org/2021.mrl-1.7
DOI:
10.18653/v1/2021.mrl-1.7
Bibkey:
Cite (ACL):
Vikram Gupta. 2021. Multilingual and Multilabel Emotion Recognition using Virtual Adversarial Training. In Proceedings of the 1st Workshop on Multilingual Representation Learning, pages 74–85, Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
Multilingual and Multilabel Emotion Recognition using Virtual Adversarial Training (Gupta, MRL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.mrl-1.7.pdf
Video:
 https://aclanthology.org/2021.mrl-1.7.mp4