Scaling Human-AI Collaboration: Translating Multi-Source Assessment Data into Formative Learner Profiles

Hongwen Guo, Matthew S Johnson, Luis Saldivia, Michelle Worthington, Jeremy Lee, Kadriye Ercikan


Abstract
We present a scalable dual-agent architecture translating multi-source assessment data – integrating performance with process logs – into formative data insights. Decoupling classification from text generation, embedding expert rubrics, and optimizing latency enables rapid first-draft generation. These insights reveal underlying learning behaviors, facilitating targeted intervention without increasing teachers’ cognitive burden.
Anthology ID:
2026.aimecon-sessions.24
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Coordinated Session Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
225–235
Language:
URL:
https://aclanthology.org/2026.aimecon-sessions.24/
DOI:
Bibkey:
Cite (ACL):
Hongwen Guo, Matthew S Johnson, Luis Saldivia, Michelle Worthington, Jeremy Lee, and Kadriye Ercikan. 2026. Scaling Human-AI Collaboration: Translating Multi-Source Assessment Data into Formative Learner Profiles. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Coordinated Session Papers, pages 225–235, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Scaling Human-AI Collaboration: Translating Multi-Source Assessment Data into Formative Learner Profiles (Guo et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-sessions.24.pdf