TACTICS: Taxonomy-Aware Intelligent Corpus Sampling for Machine Translation

Prasanth Bathala, Anubhav Shrimal, Sukhdeep Singh Kharbhanda, Pradyumna Lanka, Rohit Dhaipule


Abstract
Large-scale machine-translation (MT) systems are typically evaluated on random samples from a corpus whose distributional composition is an artifact of how it was assembled. Such a sample inherits the phenomena the collection happens to contain rather than the full space a system must handle, spanning rule-governed conventions (terminology, punctuation, currency formatting) and context-dependent phenomena (tone, honorifics, document-level coherence), and thus provides no coverage guarantee for assessing robustness. We propose TACTICS (Taxonomy-Aware Coverage-opTimized Intelligent Corpus Sampling), which recasts coverage as an explicit objective. TACTICS induces a hierarchical taxonomy from a locale style guide, classifies segments against it, and selects a fixed-budget subset jointly optimizing coverage of rare categories, document-level coherence, and distributional fidelity to the full corpus. Applied to MT evaluation across four translation directions, TACTICS improves coverage of rare categories over lexical and embedding-based selection. By targeting the phenomena that separate systems, TACTICS makes a fixed evaluation budget go further, recovering the true system ranking from far fewer segments than random sampling wherever a real quality gap exists and never signaling a difference where none exists.
Anthology ID:
2026.wmt-main.2
Volume:
Proceedings of the Eleventh Conference on Machine Translation
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Barry Haddow, Tom Kocmi, Philipp Koehn, Christof Monz
Venues:
WMT | WS
SIG:
SIGMT
Publisher:
Association for Computational Linguistics
Note:
Pages:
14–32
Language:
URL:
https://aclanthology.org/2026.wmt-main.2/
DOI:
Bibkey:
Cite (ACL):
Prasanth Bathala, Anubhav Shrimal, Sukhdeep Singh Kharbhanda, Pradyumna Lanka, and Rohit Dhaipule. 2026. TACTICS: Taxonomy-Aware Intelligent Corpus Sampling for Machine Translation. In Proceedings of the Eleventh Conference on Machine Translation, pages 14–32, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TACTICS: Taxonomy-Aware Intelligent Corpus Sampling for Machine Translation (Bathala et al., WMT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wmt-main.2.pdf