Arabic Function Forge at AISA-ArabicFC: Copy, Don’t Interpret — Training-Free Arabic Function Calling

Anfal Alshehri, Jumanah Aljubayri


Abstract
Arabic Function Forge is our submission to AISA-ArabicFC 2026. Our system is training-free: it uses a single off-the-shelf open-weights model, prompted once per request, with no parameter updates. It placed fifth on Track A, fourth on Track B, and sixth on Track C. Our central observation is that function selection is nearly saturated on this benchmark while argument extraction is not: we reach 0.9893 function accuracy but only 0.8686 argument exact match, so 94.9% of the remaining headroom lies in arguments. The dominant failure is not misunderstanding but over-interpretation: the model translates values, converts dates to ISO form, and adds fields the user never provided. Our system is designed to suppress this behaviour by preserving argument values as written. We further find that the dialect penalty is concentrated rather than graded, with most of the drop occurring on Maghrebi.
Anthology ID:
2026.arabicnlp-sharedtasks.212
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1654–1657
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.212/
DOI:
Bibkey:
Cite (ACL):
Anfal Alshehri and Jumanah Aljubayri. 2026. Arabic Function Forge at AISA-ArabicFC: Copy, Don’t Interpret — Training-Free Arabic Function Calling. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1654–1657, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Arabic Function Forge at AISA-ArabicFC: Copy, Don’t Interpret — Training-Free Arabic Function Calling (Alshehri & Aljubayri, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.212.pdf