Production-Ready Automated Item Generation in Educational Assessment: Integration with Operational Workflows

Hotaka Maeda, Kargi Chauhan, Tharunya Chandrashekar


Abstract
We present a production-ready automated item generation pipeline integrated into a large-scale assessment program’s workflows. A one-shot approach prompts LLMs from an operational source item and existing guidelines, then populates metadata, screens quality, and uploads items for human review. Generated items passed expert review, and difficulty prompting reliably shifted difficulty.
Anthology ID:
2026.aimecon-wip.17
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
130–139
Language:
URL:
https://aclanthology.org/2026.aimecon-wip.17/
DOI:
Bibkey:
Cite (ACL):
Hotaka Maeda, Kargi Chauhan, and Tharunya Chandrashekar. 2026. Production-Ready Automated Item Generation in Educational Assessment: Integration with Operational Workflows. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 130–139, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Production-Ready Automated Item Generation in Educational Assessment: Integration with Operational Workflows (Maeda et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-wip.17.pdf