Evaluation of AI-generated Passages for Reading Practice: An application of causal forests

Walter L Leite, Qian Shen, Wonchae Lee, Sierra Evans, Sienna Perez, Wei Li, Jinnie Shin


Abstract
This study presents a causal approach for evalu- ating automated generation of reading passages for early readers. It consists of estimating the average treatment effect of a candidate model, then conditional average treatment effects with causal forests. We apply it to evaluate a fine- tuned model for a digital literacy platform
Anthology ID:
2026.aimecon-main.27
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
245–252
Language:
URL:
https://aclanthology.org/2026.aimecon-main.27/
DOI:
Bibkey:
Cite (ACL):
Walter L Leite, Qian Shen, Wonchae Lee, Sierra Evans, Sienna Perez, Wei Li, and Jinnie Shin. 2026. Evaluation of AI-generated Passages for Reading Practice: An application of causal forests. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 245–252, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Evaluation of AI-generated Passages for Reading Practice: An application of causal forests (Leite et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.27.pdf