Designing and Evaluating a Measurement-Oriented RAG Framework for ELL Writing Assessment

Daeryong Seo


Abstract
This design-focused study compared measurement-oriented ELL_RAG with conventional RAG for writing-assessment analytics. ELL_RAG showed a descriptive advantage overall and on global/population-level tasks, while local-evidence performance was nearly equivalent. Findings support task–evidence alignment rather than universal superiority and highlight tool orchestration as a continuing design challenge.
Anthology ID:
2026.aimecon-wip.15
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
104–112
Language:
URL:
https://aclanthology.org/2026.aimecon-wip.15/
DOI:
Bibkey:
Cite (ACL):
Daeryong Seo. 2026. Designing and Evaluating a Measurement-Oriented RAG Framework for ELL Writing Assessment. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 104–112, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Designing and Evaluating a Measurement-Oriented RAG Framework for ELL Writing Assessment (Seo, AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-wip.15.pdf