Natural, Synthetic, or Mixed Supervision for Open-Weight Arabic Grammatical Error Correction

Mohammed Alnuwaiser, Mohammed Albalawi, Thikra Mansoor Alghamdi


Abstract
Modern Standard Arabic grammatical error correction (GEC) remains underexplored for open-weight instruction-tuned large language models (LLMs). We compare natural, synthetic, and mixed training views for a highlighted-token correction task while holding the model, training-set size, and evaluation protocol fixed. We fine-tune Gemma 3 4B with QLoRA on three equal 2,000-record views and evaluate once on 511 Nahw-Passage records. Mixed supervision reaches 31.70% exact-match accuracy, compared with 20.55% for synthetic-only and 28.38% for natural-only; the mixed–natural difference is not established. Post-hoc robustness analyses preserve the mixed-over-synthetic direction, but checkpoint selection enlarges its measured size. Auxiliary diagnostics reveal a trade-off: synthetic-only changes fewer already-correct tokens, whereas mixed supervision retains more ArabicMMLU capability. The result concerns these particular data views: source also varies with domain, length, and error distribution; correction quality was not independently assessed. One model and strict single-reference scoring further limit generality.
Anthology ID:
2026.mrl-1.17
Volume:
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
David Ifeoluwa Adelani, Jesujoba Alabi, Catherine Arnett, Tyler Chang, C.M. Downey, Omer Goldman, Senyu Li, Lester James Validad Miranda, Jirui Qi, David Stap, Genta Indra Winata, Xinyu Crystina Zhang
Venues:
MRL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
221–229
Language:
URL:
https://aclanthology.org/2026.mrl-1.17/
DOI:
Bibkey:
Cite (ACL):
Mohammed Alnuwaiser, Mohammed Albalawi, and Thikra Mansoor Alghamdi. 2026. Natural, Synthetic, or Mixed Supervision for Open-Weight Arabic Grammatical Error Correction. In Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026), pages 221–229, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Natural, Synthetic, or Mixed Supervision for Open-Weight Arabic Grammatical Error Correction (Alnuwaiser et al., MRL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mrl-1.17.pdf