Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring

Zhengyang Wang, Sanwoo Lee, Jiaxin Wang, Chenxi Miao, Weikang Li, Yunfang Wu


Abstract
Multi-trait essay scoring aims to provide fine-grained evaluation of writing quality across multiple dimensions. However, how to effectively post-train autoregressive scoring models remains underexplored. In this paper, we propose Trait-Aware Policy Optimization (TAPO), a post-training framework tailored to autoregressive multi-trait scoring. Our method decomposes rewards along both the sample and trait dimensions, combining global scoring consistency, trait-level accuracy, format validity, and inter-trait dependency preservation. In addition, we use enhanced prompts throughout training by incorporating original prompt texts and trait descriptions, providing richer semantic information for trait-specific score generation. Experiments across multiple backbone models show that our method consistently improves multi-trait scoring performance over supervised fine-tuning and scalar-reward optimization baselines, demonstrating the effectiveness and transferability of trait-aware post-training for essay scoring.
Anthology ID:
2026.emnlp-main.2016
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
45923–45938
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2016/
DOI:
Bibkey:
Cite (ACL):
Zhengyang Wang, Sanwoo Lee, Jiaxin Wang, Chenxi Miao, Weikang Li, and Yunfang Wu. 2026. Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 45923–45938, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Trait-Aware Policy Optimization for Autoregressive Multi-Trait Essay Scoring (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2016.pdf