SpinPop: A Fast Spin Metric for the WMT26 Metrics Shared Task

Jia Xu


Abstract
We describe our submission to the WMT26 Shared Task on Automated Translation Quality Evaluation. Our primary system is a per-language-pair, z-normalized, weight-free ensemble that combines six complementary signals: our novel metric SpinPop, COMET-22, and four large language model judges.

SpinPop is training-free, constant-cost, tokenization-agnostic, broadly multilingual, and deterministic. Within its encoder’s language coverage it scores every segment, with or without a reference, using a single frozen-encoder pass that runs locally and requires no paid API calls.

Our system achieves a mean per-language-pair Pearson correlation of $0.8534$, ranking second on the WMT26 Task~2 leaderboard. The results demonstrate that a simple unsupervised ensemble of a spin-code metric, a neural metric, and multiple LLM judges can achieve top-tier performance with equal weights.
Anthology ID:
2026.wmt-main.110
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1757–1762
Language:
URL:
https://aclanthology.org/2026.wmt-main.110/
DOI:
Bibkey:
Cite (ACL):
Jia Xu. 2026. SpinPop: A Fast Spin Metric for the WMT26 Metrics Shared Task. In Proceedings of the Eleventh Conference on Machine Translation, pages 1757–1762, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SpinPop: A Fast Spin Metric for the WMT26 Metrics Shared Task (Xu, WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.110.pdf