dzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformers

Mohamed Lichouri, Khaled Lounnas, Ouaras Rafik, Mohamed ABi, Anis Guechtouli


Abstract
This study compares Term Frequency-Inverse Document Frequency (TF-IDF) features with Sentence Transformers for detecting writers’ stances—favorable, opposing, or neutral—towards three significant topics: COVID-19 vaccine, digital transformation, and women empowerment. Through empirical evaluation, we demonstrate that Sentence Transformers outperform TF-IDF features across various experimental setups. Our team, dzStance, participated in a stance detection competition, achieving the 13th position (74.91%) among 15 teams in Women Empowerment, 10th (73.43%) in COVID Vaccine, and 12th (66.97%) in Digital Transformation. Overall, our team’s performance ranked 13th (71.77%) among all participants. Notably, our approach achieved promising F1-scores, highlighting its effectiveness in identifying writers’ stances on diverse topics. These results underscore the potential of Sentence Transformers to enhance stance detection models for addressing critical societal issues.
Anthology ID:
2024.arabicnlp-1.91
Volume:
Proceedings of The Second Arabic Natural Language Processing Conference
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Nizar Habash, Houda Bouamor, Ramy Eskander, Nadi Tomeh, Ibrahim Abu Farha, Ahmed Abdelali, Samia Touileb, Injy Hamed, Yaser Onaizan, Bashar Alhafni, Wissam Antoun, Salam Khalifa, Hatem Haddad, Imed Zitouni, Badr AlKhamissi, Rawan Almatham, Khalil Mrini
Venues:
ArabicNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
794–799
Language:
URL:
https://aclanthology.org/2024.arabicnlp-1.91
DOI:
Bibkey:
Cite (ACL):
Mohamed Lichouri, Khaled Lounnas, Ouaras Rafik, Mohamed ABi, and Anis Guechtouli. 2024. dzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformers. In Proceedings of The Second Arabic Natural Language Processing Conference, pages 794–799, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
dzStance at StanceEval2024: Arabic Stance Detection based on Sentence Transformers (Lichouri et al., ArabicNLP-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.arabicnlp-1.91.pdf