Minkwon Kim
Author directory2026
How Reproducible Are LLM-Generated Q-Matrices? Evidence from Downstream Classification
Minkwon Kim
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Minkwon Kim
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Regenerating LLM Q-matrices ten times per model on TIMSS 2011 items, we find two runs of the same model reassign 61–88% of student mastery profiles. Greedy decoding removes this instability; disagreement with expert judgment (63–76%) survives. Majority voting fixes neither. Report distributions, not single runs.