Michael Xiao
Author directory2026
Developing an LLM Tutor Quality Evaluation Scale
Michael Xiao | Zewei Tian | Alex Liu | Lief Esbenshade | Min Sun
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Coordinated Session Papers
Michael Xiao | Zewei Tian | Alex Liu | Lief Esbenshade | Min Sun
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Coordinated Session Papers
We introduce a unified metric set for evaluating LLM tutors by inductively coding 177 recent literature-based metrics and scoring tutoring dialogues with three LLM judges. Exploratory factor analysis identified five constructs and a strong general factor. We present the resulting 10-category, 41-item framework for confirmatory analysis and human validation.