Validating Generative AI Scoring of Constructed Responses with Cognitive Diagnosis

Hyunjoo Kim


Abstract
This research explores the feasibility of applying the cognitive diagnosis assessment (CDA) framework to validate generative AI-based scoring of constructed responses (CRs). The classification information of CRs and item-parameter estimates from cognitive diagnosis models (CDMs) could provide additional validity evidence for AI-generated CR scores and feedback.
Anthology ID:
2025.aimecon-wip.20
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2025
Address:
Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
166–177
Language:
URL:
https://aclanthology.org/2025.aimecon-wip.20/
DOI:
Bibkey:
Cite (ACL):
Hyunjoo Kim. 2025. Validating Generative AI Scoring of Constructed Responses with Cognitive Diagnosis. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 166–177, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Validating Generative AI Scoring of Constructed Responses with Cognitive Diagnosis (Kim, AIME-Con 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.aimecon-wip.20.pdf