The Resistant Word at StanceNakba Shared Task: A Topic-Aware Model for Cross-Topic Stance Detection

Mohamed Bahgat, Doaa Salah, Sarah Yassine


Abstract
Cross-topic stance detection in Arabic is the task of identifying whether a text expresses a pro, against, or neutral position toward a given issue, and it is particularly challenging under topic shifts and class imbalance. In Subtask B of the StanceNakba 2026 shared task on Arabic cross-topic stance detection, we are given a Levantine Arabic sentence and one of two topics: “Normalization with Israel” or “Refugee/Immigrant Presence in Jordan,” and we must classify the expressed stance. A central difficulty is the systematic failure of standard fine-tuning to recognize the minority neutral class, driven by majority-class dominance in cross-entropy training and accuracy-based checkpoint selection. To address this, we combine random oversampling with class-weighted cross-entropy loss, and we build an ensemble of four Arabic pre-trained transformers MARBERT, AraBERT Large, XLM-RoBERTa Base, and CAMeL-BERT Mix each trained using Stratified 5-Fold cross-validation. Our final system achieves a macro-F1 of 0.9777 and an accuracy of 97.79% on the evaluation set.
Anthology ID:
2026.nakbanlp-1.24
Volume:
Proceedings of the 2nd International Workshop on Nakba Narratives as Language Resources @ LREC 2026
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Mustafa Jarrar, Mo El-Haj, Amal Haddad, Serin Atiani, Shadi Abudalfa, Terry Regier, Paul Rayson, Khalil Sima’an, Camille Mansour
Venues:
NakbaNLP | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
182–186
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-nakbanlp-24
DOI:
10.63317/33r5jdoe6avj
Bibkey:
Cite (ACL):
Mohamed Bahgat, Doaa Salah, and Sarah Yassine. 2026. The Resistant Word at StanceNakba Shared Task: A Topic-Aware Model for Cross-Topic Stance Detection. In Proceedings of the 2nd International Workshop on Nakba Narratives as Language Resources @ LREC 2026, pages 182–186, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
The Resistant Word at StanceNakba Shared Task: A Topic-Aware Model for Cross-Topic Stance Detection (Bahgat et al., NakbaNLP 2026)
Copy Citation: