Explainable Writing Scores via Fine-grained, LLM-Generated Features

James V Bruno, Lee Becker


Abstract
Advancements in deep learning have enhanced Automated Essay Scoring (AES) accuracy but reduced interpretability. This paper investigates using LLM-generated features to train an explainable scoring model. By framing feature engineering as prompt engineering, state-of-the-art language technology can be integrated into simpler, more interpretable AES models.
Anthology ID:
2025.aimecon-wip.19
Volume:
Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress
Month:
October
Year:
2025
Address:
Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States
Editors:
Joshua Wilson, Christopher Ormerod, Magdalen Beiting Parrish
Venue:
AIME-Con
SIG:
Publisher:
National Council on Measurement in Education (NCME)
Note:
Pages:
155–165
Language:
URL:
https://aclanthology.org/2025.aimecon-wip.19/
DOI:
Bibkey:
Cite (ACL):
James V Bruno and Lee Becker. 2025. Explainable Writing Scores via Fine-grained, LLM-Generated Features. In Proceedings of the Artificial Intelligence in Measurement and Education Conference (AIME-Con): Works in Progress, pages 155–165, Wyndham Grand Pittsburgh, Downtown, Pittsburgh, Pennsylvania, United States. National Council on Measurement in Education (NCME).
Cite (Informal):
Explainable Writing Scores via Fine-grained, LLM-Generated Features (Bruno & Becker, AIME-Con 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.aimecon-wip.19.pdf