AraScholar: Calibrating Academic Paraphrasing in Modern Standard Arabic

Omer Nacar, Asma Al Wazrah, Rawan Nasser Almatham, Afrah Altamimi, Abdulrahman Alosaimy


Abstract
Academic paraphrasing in Modern Standard Arabic must change expression without distorting scientific content. We study this balance through AraScholar, a corpus of 20,002 manually written source–paraphrase pairs with 522 raw domain labels and item-level provenance. On 2,000 held-out sentences, fine-tuned AraT5v2 favors lexical reuse under beam search, while frontier models produce more extensive rewrites. With corrected Arabic punctuation normalization, diverse decoding and preservation-constrained reranking attain 74.25% coverage of a fixed novelty–preservation band, compared with 52.60% for zero-shot GPT-4o. Gold coverage is only 46.65%, showing that this band measures constraint compliance rather than human quality. Post-hoc target matching substantially improves a calibrated GPT-4o control and narrows the gap, although candidate budgets differ. Crucially, an independent 200-instance audit favors frontier models on meaning and paraphrase quality. We document the corpus, decoding controls, negative distillation result, and metric sensitivity, including test-derived calibration and checkpoint-selection limitations. The findings establish operating-point control as a useful capability while demonstrating why calibration must be evaluated alongside independent assessments of writing quality.
Anthology ID:
2026.arabicnlp-main.24
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
340–355
Language:
URL:
https://aclanthology.org/2026.arabicnlp-main.24/
DOI:
Bibkey:
Cite (ACL):
Omer Nacar, Asma Al Wazrah, Rawan Nasser Almatham, Afrah Altamimi, and Abdulrahman Alosaimy. 2026. AraScholar: Calibrating Academic Paraphrasing in Modern Standard Arabic. In Proceedings of The Fourth Arabic Natural Language Processing Conference, pages 340–355, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AraScholar: Calibrating Academic Paraphrasing in Modern Standard Arabic (Nacar et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-main.24.pdf