T-MES: Trait-Aware Mix-of-Experts Representation Learning for Multi-trait Essay Scoring

Jiong Wang, Jie Liu


Abstract
In current research on automatic essay scoring, related work tends to focus more on evaluating the overall quality or a single trait of prompt-specific essays. However, when scoring essays in an educational context, it is essential not only to consider the overall score but also to provide feedback on various aspects of the writing. This helps students clearly identify areas for improvement, enabling them to engage in targeted practice. Although many methods have been proposed to address the scoring issue, they still suffer from insufficient learning of trait representations and overlook the diversity and correlations between trait scores in the scoring process. To address this problem, we propose a novel multi-trait essay scoring method based on Trait-Aware Mix-of-Experts Representation Learning. Our method obtains trait-specific essay representations using a Mix-of-Experts scoring architecture. Furthermore, based on this scoring architecture, we propose a diversified trait-expert method to learn distinguishable expert weights. And to facilitate multi-trait scoring, we introduce two trait correlation learning strategies that achieve learning the correlations among traits. Experimental results demonstrate the effectiveness of our method, and compared to existing methods, it achieves a further improvement in computational efficiency.
Anthology ID:
2025.coling-main.81
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1224–1236
Language:
URL:
https://aclanthology.org/2025.coling-main.81/
DOI:
Bibkey:
Cite (ACL):
Jiong Wang and Jie Liu. 2025. T-MES: Trait-Aware Mix-of-Experts Representation Learning for Multi-trait Essay Scoring. In Proceedings of the 31st International Conference on Computational Linguistics, pages 1224–1236, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
T-MES: Trait-Aware Mix-of-Experts Representation Learning for Multi-trait Essay Scoring (Wang & Liu, COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.81.pdf