SCaLAR at SemEval-2024 Task 8: Unmasking the machine : Exploring the power of RoBERTa Ensemble for Detecting Machine Generated Text

Anand Kumar, Abhin B, Sidhaarth Murali


Abstract
SemEval SubtaskB, a shared task that is concerned with the detection of text generated by one out of the 5 different models - davinci, bloomz, chatGPT, cohere and dolly. This is an important task considering the boom of generative models in the current day scenario and their ability to draft mails, formal documents, write and qualify exams and many more which keep evolving every passing day. The purpose of classifying text as generated by which pre-trained model helps in analyzing how each of the training data has affected the ability of the model in performing a certain given task. In the proposed approach, data augmentation was done in order to handle lengthier sentences and also labelling them with the same parent label. Upon the augmented data three RoBERTa models were trained on different segments of data which were then ensembled using a voting classifier based on their R2 score to achieve a higher accuracy than the individual models itself. The proposed model achieved an overall validation accuracy of 97.05% and testing accuracy of 76.25%. and our standing was 18th position on the leaderboard.
Anthology ID:
2024.semeval-1.165
Volume:
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Harish Tayyar Madabushi, Giovanni Da San Martino, Sara Rosenthal, Aiala Rosá
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1135–1139
Language:
URL:
https://aclanthology.org/2024.semeval-1.165
DOI:
10.18653/v1/2024.semeval-1.165
Bibkey:
Cite (ACL):
Anand Kumar, Abhin B, and Sidhaarth Murali. 2024. SCaLAR at SemEval-2024 Task 8: Unmasking the machine : Exploring the power of RoBERTa Ensemble for Detecting Machine Generated Text. In Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), pages 1135–1139, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
SCaLAR at SemEval-2024 Task 8: Unmasking the machine : Exploring the power of RoBERTa Ensemble for Detecting Machine Generated Text (Kumar et al., SemEval 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.semeval-1.165.pdf
Supplementary material:
 2024.semeval-1.165.SupplementaryMaterial.txt
Supplementary material:
 2024.semeval-1.165.SupplementaryMaterial.zip