RoMa at SemEval-2021 Task 7: A Transformer-based Approach for Detecting and Rating Humor and Offense

Roberto Labadie, Mariano Jason Rodriguez, Reynier Ortega, Paolo Rosso


Abstract
In this paper we describe the systems used by the RoMa team in the shared task on Detecting and Rating Humor and Offense (HaHackathon) at SemEval 2021. Our systems rely on data representations learned through fine-tuned neural language models. Particularly, we explore two distinct architectures. The first one is based on a Siamese Neural Network (SNN) combined with a graph-based clustering method. The SNN model is used for learning a latent space where instances of humor and non-humor can be distinguished. The clustering method is applied to build prototypes of both classes which are used for training and classifying new messages. The second one combines neural language model representations with a linear regression model which makes the final ratings. Our systems achieved the best results for humor classification using model one, whereas for offensive and humor rating the second model obtained better performance. In the case of the controversial humor prediction, the most significant improvement was achieved by a fine-tuning of the neural language model. In general, the results achieved are encouraging and give us a starting point for further improvements.
Anthology ID:
2021.semeval-1.37
Volume:
Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Alexis Palmer, Nathan Schneider, Natalie Schluter, Guy Emerson, Aurelie Herbelot, Xiaodan Zhu
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
297–305
Language:
URL:
https://aclanthology.org/2021.semeval-1.37
DOI:
10.18653/v1/2021.semeval-1.37
Bibkey:
Cite (ACL):
Roberto Labadie, Mariano Jason Rodriguez, Reynier Ortega, and Paolo Rosso. 2021. RoMa at SemEval-2021 Task 7: A Transformer-based Approach for Detecting and Rating Humor and Offense. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 297–305, Online. Association for Computational Linguistics.
Cite (Informal):
RoMa at SemEval-2021 Task 7: A Transformer-based Approach for Detecting and Rating Humor and Offense (Labadie et al., SemEval 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.semeval-1.37.pdf