Sabaa at DialectSentEval Shared Task Subtask-2: Classifier-Guided Candidate Reranking for Arabic Dialectal Sentiment Swap

Mohamed Sabaa, Amr Sabaa


Abstract
Sentiment swap asks a system to rewrite a sentence so that its polarity is inverted while everything else stays the same, two halves of an instruction that pull against each other. This paper describes how the Sabaa system navigates that trade-off for Arabic dialects in Subtask 2 of DialectSentEval 2026. Rather than asking one model for a single correct rewrite, we ask two fine-tuned Arabic sequence-to-sequence models to each propose several, then choose among the pooled proposals with a scoring function built from the signals the task grades us on. The system scores 49.07 BLEU, 69.33 chrF, and 0.7447 sentiment accuracy on the official test set. That last figure is the most informative result here: the system places 90.37% of its outputs at the polarity it was aiming for, and the shortfall traces to inferring each sentence’s original polarity, which the test data withholds. Measured against gold labels on development, that inference is correct only 74.07% of the time, and sixteen points of sentiment accuracy separate our submission from a perfect estimator.
Anthology ID:
2026.arabicnlp-sharedtasks.173
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1389–1393
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.173/
DOI:
Bibkey:
Cite (ACL):
Mohamed Sabaa and Amr Sabaa. 2026. Sabaa at DialectSentEval Shared Task Subtask-2: Classifier-Guided Candidate Reranking for Arabic Dialectal Sentiment Swap. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1389–1393, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Sabaa at DialectSentEval Shared Task Subtask-2: Classifier-Guided Candidate Reranking for Arabic Dialectal Sentiment Swap (Sabaa & Sabaa, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.173.pdf