Rubric Spans are Label Representations: Joint LLM Encoding for Short Answer Scoring

Zhifan Sun, Sebastian Gombert, Fabian Zehner, Leon Camus, Longwei Cong, Hendrik Drachsler


Abstract
Automatic Short Answer Scoring (ASAS) requires models that can score student responses against question-specific criteria while remaining efficient and transferable across rubric sets. We propose RUSPAN, a rubric-conditioned ASAS framework that treats rubric descriptions as semantic label representations. RUSPAN serialises the question context, student answer, and all candidate rubric levels into a single sequence, then scores the levels listwise from the rubric-span and whole-sequence representations produced in a single LM pass. We further introduce RUSPAN-RIM, in which a Rubric-Independent Mask prevents rubric spans from attending to one another, making rubric representations depend only on the answer and question context and preventing overfitting to rubric patterns during training for zero-shot transfer. On six ASAS benchmarks spanning English, German, and Portuguese, RUSPAN improves mono-benchmark scoring over discriminative and generative baselines, while RIM with position reindexing delivers consistent and substantial gains on PT-ASAG, the held-out benchmark with the strongest combined language and rubric-structure shift.
Anthology ID:
2026.emnlp-main.662
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15246–15266
Language:
URL:
https://aclanthology.org/2026.emnlp-main.662/
DOI:
Bibkey:
Cite (ACL):
Zhifan Sun, Sebastian Gombert, Fabian Zehner, Leon Camus, Longwei Cong, and Hendrik Drachsler. 2026. Rubric Spans are Label Representations: Joint LLM Encoding for Short Answer Scoring. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 15246–15266, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Rubric Spans are Label Representations: Joint LLM Encoding for Short Answer Scoring (Sun et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.662.pdf