Oluwatobi Joseph Abiola
2025
CIC-NLP at GenAI Detection Task 1: Leveraging DistilBERT for Detecting Machine-Generated Text in English
Tolulope Olalekan Abiola
|
Tewodros Achamaleh Bizuneh
|
Oluwatobi Joseph Abiola
|
Temitope Olasunkanmi Oladepo
|
Olumide Ebenezer Ojo
|
Grigori Sidorov
|
Olga Kolesnikova
Proceedings of the 1stWorkshop on GenAI Content Detection (GenAIDetect)
As machine-generated texts (MGT) become increasingly similar to human writing, these dis- tinctions are harder to identify. In this paper, we as the CIC-NLP team present our submission to the Gen-AI Content Detection Workshop at COLING 2025 for Task 1 Subtask A, which involves distinguishing between text generated by LLMs and text authored by humans, with an emphasis on detecting English-only MGT. We applied the DistilBERT model to this binary classification task using the dataset provided by the organizers. Fine-tuning the model effectively differentiated between the classes, resulting in a micro-average F1-score of 0.70 on the evaluation test set. We provide a detailed explanation of the fine-tuning parameters and steps involved in our analysis.