Long-Context Transformer and State-Space Architectures for Data-Efficient Automated Essay Scoring

Justin O Barber, Michael P Hemenway, Martha Bellows, Susan Lottridge


Abstract
We compare long-context architectures (ModernBERT, Longformer, and causal and bidirectional Mamba) for data-efficient automated essay scoring across four training sizes on ASAP-2. Bidirectional Mamba matches the transformers. Deployment readiness depends more on label quantity (rising from 60% to 84% as training grows from 128 to 512 essays) than on backbone choice.
Anthology ID:
2026.aimecon-main.46
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers
Month:
October
Year:
2026
Address:
Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting-Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
413–420
Language:
URL:
https://aclanthology.org/2026.aimecon-main.46/
DOI:
Bibkey:
Cite (ACL):
Justin O Barber, Michael P Hemenway, Martha Bellows, and Susan Lottridge. 2026. Long-Context Transformer and State-Space Architectures for Data-Efficient Automated Essay Scoring. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Full Papers, pages 413–420, Wyndham Grand Pittsburgh Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Long-Context Transformer and State-Space Architectures for Data-Efficient Automated Essay Scoring (Barber et al., AIME-Con 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aimecon-main.46.pdf