Exploring AI-Enabled Test Practice, Affect, and Test Outcomes in Language Assessment

Jill Burstein, Ramsey Cardwell, Ping-Lin Chuang, Allison Michalowski, Steven Nydick


Abstract
We analyzed data from 25,969 test takers of a high-stakes, computer-adaptive English proficiency test to examine relationships between repeated use of AI-generated practice tests and performance, affect, and score-sharing behavior. Taking 1–3 practice tests was associated with higher scores and confidence, while higher usage showed different engagement and outcome
Anthology ID:
2025.aimecon-main.7
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2025
Address:
Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
50–57
Language:
URL:
https://aclanthology.org/2025.aimecon-main.7/
DOI:
Bibkey:
Cite (ACL):
Jill Burstein, Ramsey Cardwell, Ping-Lin Chuang, Allison Michalowski, and Steven Nydick. 2025. Exploring AI-Enabled Test Practice, Affect, and Test Outcomes in Language Assessment. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 50–57, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Exploring AI-Enabled Test Practice, Affect, and Test Outcomes in Language Assessment (Burstein et al., AIME-Con 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.aimecon-main.7.pdf