Source-Text-Conditioned Cloze Generation for Discourse Comprehension Assessment in Intelligent Textbooks

Langdon Holmes, Wesley Morris, Scott Andrew Crossley, Aiden Min


Abstract
Cloze exercises offer scalable comprehension assessment, but their validity depends on which words are selected as gaps. We compared three automated methods for cloze exercises generated from summaries within an intelligent textbook platform. Conditioning masked language model predictions on the source text (contextuality-plus) produced higher quality and more source-dependent gaps.
Anthology ID:
2026.aimecon-main.59
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
525–533
Language:
URL:
https://aclanthology.org/2026.aimecon-main.59/
DOI:
Bibkey:
Cite (ACL):
Langdon Holmes, Wesley Morris, Scott Andrew Crossley, and Aiden Min. 2026. Source-Text-Conditioned Cloze Generation for Discourse Comprehension Assessment in Intelligent Textbooks. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 525–533, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Source-Text-Conditioned Cloze Generation for Discourse Comprehension Assessment in Intelligent Textbooks (Holmes et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.59.pdf