AI-Enabled Quality Assurance for Multiple-Choice Assessment Items

Steven James Moore, Nicholas Diana


Abstract
Generating multiple-choice questions is increasingly scalable, but establishing their quality remains difficult. We review fourteen reports on automated item-writing flaw detection, revision, psychometric screening, and benchmark auditing. High accuracy often masks weak detection of flawed items, and revision evidence is mixed. We propose evaluating quality assurance as independently validated decisions.
Anthology ID:
2026.aimecon-wip.58
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
464–471
Language:
URL:
https://aclanthology.org/2026.aimecon-wip.58/
DOI:
Bibkey:
Cite (ACL):
Steven James Moore and Nicholas Diana. 2026. AI-Enabled Quality Assurance for Multiple-Choice Assessment Items. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 464–471, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
AI-Enabled Quality Assurance for Multiple-Choice Assessment Items (Moore & Diana, AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-wip.58.pdf