Shelley Rap
Author directory2026
Interpretable Humans, Alien LLMs: Expert Analysis of Latent Structures in Assessment Responses
Alona Strugatski | Licol Zeinfeld | Jason Cooper | Shelley Rap | Gil Schwarts | Giora Alexandron
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Alona Strugatski | Licol Zeinfeld | Jason Cooper | Shelley Rap | Gil Schwarts | Giora Alexandron
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Applying Exploratory Factor Analysis to human and LLM responses on chemistry and quantitative reasoning assessments, we asked domain experts to blindly interpret emergent factors. Experts decoded human factors successfully but could not interpret most LLM factors, suggesting LLMs rely on statistically opaque mechanisms distinct from human cognitive constructs.