ChaPat at SemEval-2023 Task 9: Text Intimacy Analysis using Ensembles of Multilingual Transformers

Tanmay Chavan, Ved Patwardhan


Abstract
Intimacy estimation of a given text has recently gained importance due to the increase in direct interaction of NLP systems with humans. Intimacy is an important aspect of natural language and has a substantial impact on our everyday communication. Thus the level of intimacy can provide us with deeper insights and richer semantics of conversations. In this paper, we present our work on the SemEval shared task 9 on predicting the level of intimacy for the given text. The dataset consists of tweets in ten languages, out of which only six are available in the training dataset. We conduct several experiments and show that an ensemble of multilingual models along with a language-specific monolingual model has the best performance. We also evaluate other data augmentation methods such as translation and present the results. Lastly, we study the results thoroughly and present some noteworthy insights into this problem.
Anthology ID:
2023.semeval-1.181
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1304–1310
Language:
URL:
https://aclanthology.org/2023.semeval-1.181
DOI:
10.18653/v1/2023.semeval-1.181
Bibkey:
Cite (ACL):
Tanmay Chavan and Ved Patwardhan. 2023. ChaPat at SemEval-2023 Task 9: Text Intimacy Analysis using Ensembles of Multilingual Transformers. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1304–1310, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
ChaPat at SemEval-2023 Task 9: Text Intimacy Analysis using Ensembles of Multilingual Transformers (Chavan & Patwardhan, SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.181.pdf
Video:
 https://aclanthology.org/2023.semeval-1.181.mp4