Karim Akhavan Azari
2024
Sharif-MGTD at SemEval-2024 Task 8: A Transformer-Based Approach to Detect Machine Generated Text
Seyedeh Fatemeh Ebrahimi
|
Karim Akhavan Azari
|
Amirmasoud Iravani
|
Arian Qazvini
|
Pouya Sadeghi
|
Zeinab Taghavi
|
Hossein Sameti
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
In this paper, we delve into the realm of detecting machine-generated text (MGT) within Natural Language Processing (NLP). Our approach involves fine-tuning a RoBERTa-base Transformer, a robust neural architecture, to tackle MGT detection as a binary classification task. Specifically focusing on Subtask A (Monolingual - English) within the SemEval-2024 competition framework, our system achieves a 78.9% accuracy on the test dataset, placing us 57th among participants. While our system demonstrates proficiency in identifying human-written texts, it faces challenges in accurately discerning MGTs.
Sharif-STR at SemEval-2024 Task 1: Transformer as a Regression Model for Fine-Grained Scoring of Textual Semantic Relations
Seyedeh Fatemeh Ebrahimi
|
Karim Akhavan Azari
|
Amirmasoud Iravani
|
Hadi Alizadeh
|
Zeinab Taghavi
|
Hossein Sameti
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
This paper explores semantic textual relatedness (STR) using fine-tuning techniques on the RoBERTa transformer model, focusing on sentence-level STR within Track A (Supervised). The study evaluates the effectiveness of this approach across different languages, with promising results in English and Spanish but encountering challenges in Arabic.
Search
Co-authors
- Seyedeh Fatemeh Ebrahimi 2
- Amirmasoud Iravani 2
- Zeinab Taghavi 2
- Hossein Sameti 2
- Arian Qazvini 1
- show all...