Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the Art

Shengjie Li, Vincent Ng


Abstract
Cross-prompt automated essay scoring (AES), an under-investigated but challenging task that has gained increasing popularity in the AES community, aims to train an AES system that can generalize well to prompts that are unseen during model training. While recently-developed cross-prompt AES models have combined essay representations that are learned via sophisticated neural architectures with so-called prompt-independent features, an intriguing question is: are complex neural models needed to achieve state-of-the-art results? We answer this question by abandoning sophisticated neural architectures and developing a purely feature-based approach to cross-prompt AES that adopts a simple neural architecture. Experiments on the ASAP dataset demonstrate that our simple approach to cross-prompt AES can achieve state-of-the-art results.
Anthology ID:
2024.acl-long.414
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7661–7681
Language:
URL:
https://aclanthology.org/2024.acl-long.414
DOI:
Bibkey:
Cite (ACL):
Shengjie Li and Vincent Ng. 2024. Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the Art. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7661–7681, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Conundrums in Cross-Prompt Automated Essay Scoring: Making Sense of the State of the Art (Li & Ng, ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.414.pdf