Humor@IITK at SemEval-2021 Task 7: Large Language Models for Quantifying Humor and Offensiveness

Aishwarya Gupta, Avik Pal, Bholeshwar Khurana, Lakshay Tyagi, Ashutosh Modi


Abstract
Humor and Offense are highly subjective due to multiple word senses, cultural knowledge, and pragmatic competence. Hence, accurately detecting humorous and offensive texts has several compelling use cases in Recommendation Systems and Personalized Content Moderation. However, due to the lack of an extensive labeled dataset, most prior works in this domain haven’t explored large neural models for subjective humor understanding. This paper explores whether large neural models and their ensembles can capture the intricacies associated with humor/offense detection and rating. Our experiments on the SemEval-2021 Task 7: HaHackathon show that we can develop reasonable humor and offense detection systems with such models. Our models are ranked 3rd in subtask 1b and consistently ranked around the top 33% of the leaderboard for the remaining subtasks.
Anthology ID:
2021.semeval-1.36
Volume:
Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Alexis Palmer, Nathan Schneider, Natalie Schluter, Guy Emerson, Aurelie Herbelot, Xiaodan Zhu
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
290–296
Language:
URL:
https://aclanthology.org/2021.semeval-1.36
DOI:
10.18653/v1/2021.semeval-1.36
Bibkey:
Cite (ACL):
Aishwarya Gupta, Avik Pal, Bholeshwar Khurana, Lakshay Tyagi, and Ashutosh Modi. 2021. Humor@IITK at SemEval-2021 Task 7: Large Language Models for Quantifying Humor and Offensiveness. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 290–296, Online. Association for Computational Linguistics.
Cite (Informal):
Humor@IITK at SemEval-2021 Task 7: Large Language Models for Quantifying Humor and Offensiveness (Gupta et al., SemEval 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.semeval-1.36.pdf
Code
 aishgupta/Quantifying-Humor-Offensiveness