Predicting IRT Parameters for Passage-Based Reading Items Using NLP

Ruitao Liu


Abstract
This study predicts IRT item difficulty and discrimination for passage-based reading comprehension items using lexical, syntactic, and semantic NLP features. Modeling interactions among passages, stems, and options, Light- GBM with semantic embeddings best predicts difficulty (r = 0.594), while discrimination remains harder to recover from text alone.
Anthology ID:
2026.aimecon-main.4
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
30–35
Language:
URL:
https://aclanthology.org/2026.aimecon-main.4/
DOI:
Bibkey:
Cite (ACL):
Ruitao Liu. 2026. Predicting IRT Parameters for Passage-Based Reading Items Using NLP. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 30–35, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Predicting IRT Parameters for Passage-Based Reading Items Using NLP (Liu, AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.4.pdf