Evidence-Centered Design for AI-Driven Automated Item Generation in Applied Mathematics

Edith Aurora Graf, Maria Elena Oliveri, Giulia Oliveri, Emily Proctor


Abstract
We discuss how human-led Evidence-Centered Design (ECD) can inform the development of AI-supported automated item generation (AIG), as well as how it can be used as a quality-control mechanism. In this particular application, we describe how we collaborated with Claude Sonnet 5 to produce kinematics items together with interactive tools through an AIG pipeline. A preliminary qualitative analysis of a small number of generated items suggested they have identifiable strengths and weaknesses, which we discuss in depth per item.
Anthology ID:
2026.aimecon-sessions.22
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Coordinated Session Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
210–218
Language:
URL:
https://aclanthology.org/2026.aimecon-sessions.22/
DOI:
Bibkey:
Cite (ACL):
Edith Aurora Graf, Maria Elena Oliveri, Giulia Oliveri, and Emily Proctor. 2026. Evidence-Centered Design for AI-Driven Automated Item Generation in Applied Mathematics. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Coordinated Session Papers, pages 210–218, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Evidence-Centered Design for AI-Driven Automated Item Generation in Applied Mathematics (Graf et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-sessions.22.pdf