Measuring Writing Proficiency Through Keystroke Process Data: A Cross-School Generalizability Study

Damilola Babalola, Naga Buddarapu, Caleb Scott, Piotr Mitros, Paul Deane, Collin Lynch


Abstract
Using a year of authentic Grade 7–8 writing from two U.S. middle schools (8,576 documents, 423 students), we test whether keystroke features correlate with English Language Arts proficiency, form interpretable latent dimensions, and vary by gender. Fluency and engagement features reliably index proficiency by Grade 8, though generalizability varies.
Anthology ID:
2026.aimecon-wip.46
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
358–368
Language:
URL:
https://aclanthology.org/2026.aimecon-wip.46/
DOI:
Bibkey:
Cite (ACL):
Damilola Babalola, Naga Buddarapu, Caleb Scott, Piotr Mitros, Paul Deane, and Collin Lynch. 2026. Measuring Writing Proficiency Through Keystroke Process Data: A Cross-School Generalizability Study. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 358–368, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Measuring Writing Proficiency Through Keystroke Process Data: A Cross-School Generalizability Study (Babalola et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-wip.46.pdf