Assessing Small Language Models as Decimal-Arithmetic Tutors: A Measurement Framework

Mai Que Vuong, Shahana Ahmadli, Michelle Zhou, Minseok Kim, Shruti Mehta, Talita de Paula Cypriano de Souza, Seiji Isotani


Abstract
Small language models (SLMs) are increasingly proposed for educational use because they promise lower cost, offline deployment, and stronger data privacy. We report an exploratory evaluation of three sub-2B-parameter models on example-based decimal-arithmetic tutoring. Across structured interactions, all three produced fluent, confident output that masked unstable pedagogy and frequent mathematical errors even on elementary decimal addition and place-value tasks. Building on these observations, we describe an emerging interaction-based measurement framework intended to support more defensible readiness decisions about SLMs as math tutors.
Anthology ID:
2026.aimecon-wip.51
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
397–404
Language:
URL:
https://aclanthology.org/2026.aimecon-wip.51/
DOI:
Bibkey:
Cite (ACL):
Mai Que Vuong, Shahana Ahmadli, Michelle Zhou, Minseok Kim, Shruti Mehta, Talita de Paula Cypriano de Souza, and Seiji Isotani. 2026. Assessing Small Language Models as Decimal-Arithmetic Tutors: A Measurement Framework. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 397–404, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Assessing Small Language Models as Decimal-Arithmetic Tutors: A Measurement Framework (Vuong et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-wip.51.pdf