PICT at StanceEval2024: Stance Detection in Arabic using Ensemble of Large Language Models

Ishaan Shukla, Ankit Vaidya, Geetanjali Kale


Abstract
This paper outlines our approach to the StanceEval 2024- Arabic Stance Evaluation shared task. The goal of the task was to identify the stance, one out of three (Favor, Against or None) towards tweets based on three topics, namely- COVID-19 Vaccine, Digital Transformation and Women Empowerment. Our approach consists of fine-tuning BERT-based models efficiently for both, Single-Task Learning as well as Multi-Task Learning, the details of which are discussed. Finally, an ensemble was implemented on the best-performing models to maximize overall performance. We achieved a macro F1 score of 78.02% in this shared task. Our codebase is available publicly.
Anthology ID:
2024.arabicnlp-1.99
Volume:
Proceedings of The Second Arabic Natural Language Processing Conference
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
837–841
Language:
URL:
https://aclanthology.org/2024.arabicnlp-1.99
DOI:
10.18653/v1/2024.arabicnlp-1.99
Bibkey:
Cite (ACL):
Ishaan Shukla, Ankit Vaidya, and Geetanjali Kale. 2024. PICT at StanceEval2024: Stance Detection in Arabic using Ensemble of Large Language Models. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 837–841, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
PICT at StanceEval2024: Stance Detection in Arabic using Ensemble of Large Language Models (Shukla et al., ArabicNLP-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.arabicnlp-1.99.pdf