Beyond “Three-in-a-Row”: Toward Fairer Adaptive Mastery Decisions in AI-Supported Formative Assessment

Chunling Niu, Kelly D Bradley, Brian F Waltman, Biao Ma


Abstract
We compare the traditional three-correct-in-a-row mastery rule with an adaptive, measurement-informed mastery model using ASSISTments Skill Builder data. The adaptive model produced more consistent decisions overall, especially early in learning, while rule-based mastery varied across skills, templates, and hint use, suggesting a need for context-sensitive formative decision frameworks.
Anthology ID:
2026.aimecon-main.76
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
673–680
Language:
URL:
https://aclanthology.org/2026.aimecon-main.76/
DOI:
Bibkey:
Cite (ACL):
Chunling Niu, Kelly D Bradley, Brian F Waltman, and Biao Ma. 2026. Beyond “Three-in-a-Row”: Toward Fairer Adaptive Mastery Decisions in AI-Supported Formative Assessment. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 673–680, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Beyond “Three-in-a-Row”: Toward Fairer Adaptive Mastery Decisions in AI-Supported Formative Assessment (Niu et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.76.pdf