Thomas Christie
Author directory2026
Calibrated, Interpretable Automated Scoring with LLM Likelihoods
Thomas Christie | Markus Hauru | Anna Rafferty
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Thomas Christie | Markus Hauru | Anna Rafferty
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Paradigms like IRT use measurement equations to model student behavior probabilistically. We investigate an analogous LLM-based approach, the noisy channel model, to compute and compare the conditional likelihoods of student writing and produce auditable token-level inferences about student skills. We compare against other LLM-based methods on accuracy, calibration, and interpretability.