GRAFE: Graph-Reasoned Automated Feedback and Evaluation for Structure-Aware Essay Assessment

Hanyao Wei, Jun Zhong, Guang Cheng Feng, Li Kong, Xudong Tian, Junsheng Zhou


Abstract
Automated Writing Evaluation has shifted from score-centered assessment toward revision-oriented feedback. However, current Large Language Models (LLMs) often generate generic comments that overlook essays’ explicit structure and discourse-level flaws. We propose Graph-Reasoned Automated Feedback and Evaluation (GRAFE), which uses genre-specific structural graphs to guide score-feedback generation. GRAFE encodes discourse-level priors, including argumentation logic, evidence integration, and narrative progression, as continuous representations injected into the LLM. Furthermore, we introduce a training pipeline that combines two-stage Supervised Fine-Tuning for score-calibrated initialization with Group Relative Policy Optimization to align the model toward structural diagnostic accuracy, scoring consistency, and format compliance. We construct a graph-augmented ASAP++ feedback dataset with an expert-calibrated evaluation set. Experiments show that GRAFE outperforms text-only baselines on Structure-Aware Diagnosis and Structure-Grounded Actionability, demonstrating the value of explicit structural modeling.
Anthology ID:
2026.emnlp-main.1055
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24211–24223
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1055/
DOI:
Bibkey:
Cite (ACL):
Hanyao Wei, Jun Zhong, Guang Cheng Feng, Li Kong, Xudong Tian, and Junsheng Zhou. 2026. GRAFE: Graph-Reasoned Automated Feedback and Evaluation for Structure-Aware Essay Assessment. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 24211–24223, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GRAFE: Graph-Reasoned Automated Feedback and Evaluation for Structure-Aware Essay Assessment (Wei et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1055.pdf