A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring

Shihang Yang, Sanwoo Lee, Ningning Zhao, Yunfang Wu


Abstract
Multi-trait Automated Essay Scoring (AES) requires rubric-grounded reasoning across interdependent traits, rather than isolated score prediction. Existing feedback-enhanced methods often decouple feedback from scoring or assess traits independently, weakening score–feedback consistency and rubric alignment. We propose HiFTS, a unified autoregressive framework that generates hierarchical CoT feedback before predicting trait-level and holistic scores. HiFTS distills rubric-grounded hierarchical CoT feedback from a teacher LLM and trains student models to jointly generate feedback and scores. HiFTS further applies Group Relative Policy Optimization with a composite reward balancing score agreement, calibration, feedback quality, and structural validity. At inference, a lightweight global prior provides holistic guidance to reduce drift during long-form reasoning. We also introduce CFMS-34, a Chinese multi-trait AES dataset with 951 essays annotated with holistic scores and 34 rubric-based traits. Experiments on CFMS-34 and ASAP++ show that HiFTS achieves strong holistic and trait-level scoring while producing coherent, rubric-aligned feedback.
Anthology ID:
2026.findings-emnlp.863
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
18247–18260
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.863/
DOI:
10.18653/2026.findings-emnlp.863
Bibkey:
Cite (ACL):
Shihang Yang, Sanwoo Lee, Ningning Zhao, and Yunfang Wu. 2026. A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 18247–18260, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring (Yang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.863.pdf