Makeen at AISA-ArabicFC: Grounding LLM via Extracted Spans and Generalization Trade-off in Arabic Function Calling

Nouf Alzahrany, Abir Korched, Bassam Mattar


Abstract
Reliable function calling is challenging for Arabic due to dialectal variation and limited task-specific resources. We present Makeen, a data-centric approach for the AISA-ArabicFC shared-task, and extend it with span extraction and confidence-gated routing. The best post-submission variant achieves 83.20% argument exact match and 91.11% Track B on development data under held-out (cross-validated) routing, while the submitted model achieves 82.65% argument exact match and 91.06% Track B on the blind test set, ranking 9th in Task B. We also release two Arabic tool-use datasets and show that external-tool augmentation improves unseen-tool argument exact match from 44.49% to 66.53%. These results highlight the importance of data quality, argument grounding, and tool-level generalization for Arabic function calling.
Anthology ID:
2026.arabicnlp-sharedtasks.211
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1635–1653
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.211/
DOI:
Bibkey:
Cite (ACL):
Nouf Alzahrany, Abir Korched, and Bassam Mattar. 2026. Makeen at AISA-ArabicFC: Grounding LLM via Extracted Spans and Generalization Trade-off in Arabic Function Calling. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1635–1653, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Makeen at AISA-ArabicFC: Grounding LLM via Extracted Spans and Generalization Trade-off in Arabic Function Calling (Alzahrany et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.211.pdf