William Lee
Author directory2026
LLM-As-An-Assessor: Can Open-Weight LLMs Assess Computational Thinking via Student-Designed Embodied Games?
William Lee | Sai Gattupalli | Ivon Arroyo | Brendan O’Connor
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
William Lee | Sai Gattupalli | Ivon Arroyo | Brendan O’Connor
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
We evaluate whether open-weight LLMs can assess Computational Thinking in middle-school students’ finite-state game designs against human labels. Across a rich and a sparse design, models detect some behaviors at near-human agreement but over-credit absent ones and fail at counting, loop detection, and standards mapping. Failures trace to fixable setup.