Margarita Olivera-Aguilar
Author directory2026
Rethinking Pilot Data: Evaluating LLM Synthetic Data for Scale Development
Margarita Olivera-Aguilar | Samuel H. Rikoon | Paul D. Bailey | Michael B. Kruse | Kamal Middlebrook
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Margarita Olivera-Aguilar | Samuel H. Rikoon | Paul D. Bailey | Michael B. Kruse | Kamal Middlebrook
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
This study evaluated whether LLM- synthetic data can support K-12 instrument development. We generated LLM-synthetic datasets under various prompt conditions for two surveys and one assessment. Our findings indicate that while some prompt conditions successfully reproduced the overall latent structure of the instruments, recovery of item-level parameters was generally inadequate.