Automated Scoring of Oral Reading Fluency: An examination of validity evidence

Walter L Leite, Krishna Sudeep Kumar, Jaiden Magnan, Stephanie Hammerschmidt-Snidarich, Seyedahmad Rahimi, Zoey Liu


Abstract
This study provides validity evidence for automated scoring of oral reading fluency (ORF) using off-the-shelf automatic speech recognition (ASR) models. A corpus of 320 audio recordings of 63 children collected with a digital literacy platform was used to estimate words correct per minute (WCPM) with six model variants.
Anthology ID:
2026.aimecon-main.53
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
472–482
Language:
URL:
https://aclanthology.org/2026.aimecon-main.53/
DOI:
Bibkey:
Cite (ACL):
Walter L Leite, Krishna Sudeep Kumar, Jaiden Magnan, Stephanie Hammerschmidt-Snidarich, Seyedahmad Rahimi, and Zoey Liu. 2026. Automated Scoring of Oral Reading Fluency: An examination of validity evidence. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 472–482, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Automated Scoring of Oral Reading Fluency: An examination of validity evidence (Leite et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.53.pdf