Anton Dvorkovich
Author directory2026
Dubformer at WMT26 General MT: Translating the Video, Not the Transcript
Sergey Dukanov | Maria Tsyurupa | Anton Dvorkovich
Proceedings of the Eleventh Conference on Machine Translation
Sergey Dukanov | Maria Tsyurupa | Anton Dvorkovich
Proceedings of the Eleventh Conference on Machine Translation
We describe the system Dubformer entered in the WMT26 General MT shared task, an un- constrained system built on our video-dubbing pipeline. It rests on two commitments. A doc- ument is never translated as raw text: it is first decomposed into a structure chosen for its do- main — scenes carrying speaker and audio- visual context for spoken dialogue, markup- masked segments for web documents, value- only segments for localization resources — so that non-linguistic material is protected by construction and everything needed for consis- tency is in front of the model at once. And no translation is taken on trust: every segment is checked by a second model from a different family for hallucination and for drift from the meaning of the source, and a segment it rejects is re-translated with the reason attached rather than filled in from a fallback.
Findings of the WMT26 General Machine Translation Shared Task: Contrastive Dynamic Human Evaluation at Scale
Tom Kocmi | Ekaterina Artemova | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Sergey Dukanov | Anton Dvorkovich | Mark Fishel | Markus Freitag | Samuel Frontull | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Stan Kharevich | Philipp Koehn | Zheng Li | Jean Maillard | Christof Monz | Alexander Murauski | Kenton Murray | Masaaki Nagata | Stefano Perrella | Martin Popel | Maja Popović | Lorenzo Proietti | Sara Rajaee | Parker Riley | Mariya Shmatova | Steinthór Steingrímsson | Lisa Yankovskaya | Vilem Zouhar
Proceedings of the Eleventh Conference on Machine Translation
Tom Kocmi | Ekaterina Artemova | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Sergey Dukanov | Anton Dvorkovich | Mark Fishel | Markus Freitag | Samuel Frontull | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Stan Kharevich | Philipp Koehn | Zheng Li | Jean Maillard | Christof Monz | Alexander Murauski | Kenton Murray | Masaaki Nagata | Stefano Perrella | Martin Popel | Maja Popović | Lorenzo Proietti | Sara Rajaee | Parker Riley | Mariya Shmatova | Steinthór Steingrímsson | Lisa Yankovskaya | Vilem Zouhar
Proceedings of the Eleventh Conference on Machine Translation
This paper presents the results of the General Machine Translation Task organized under the 2026 Conference on Machine Translation (WMT). Participants build systems for any of the 23 language pairs spanning four to five domains. This year we brought major changes to the human evaluation: (1) new annotation platform Pearmut for better reproducibility, (2) new human protocol "contrastive Error Span Annotation" for higher quality and side-by-side evaluation, and (3) Dynamic human evaluation that allows assessing all submitted models while evaluating higher-performing models more frequently. Beyond human evaluation, we (4) extended difficulty sampling with a human-driven stage, (5) added two new domains, (6) made the test sets fully document-level without requiring segment-level alignment and relying on HTML or JSON structure, (7) prepared some human references by post-editing open-weight model outputs, and (8) introduced contextual instructions governing formality and structural style. We evaluated 46 systems in total: 30 submitted by participants and 16 consisting of translations from large language models (LLMs) and industry translation providers.
2025
Findings of the WMT25 General Machine Translation Shared Task: Time to Stop Evaluating on Easy Test Sets
Tom Kocmi | Ekaterina Artemova | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Konstantin Dranch | Anton Dvorkovich | Sergey Dukanov | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Marzena Karpinska | Philipp Koehn | Howard Lakougna | Jessica Lundin | Christof Monz | Kenton Murray | Masaaki Nagata | Stefano Perrella | Lorenzo Proietti | Martin Popel | Maja Popović | Parker Riley | Mariya Shmatova | Steinthór Steingrímsson | Lisa Yankovskaya | Vilém Zouhar
Proceedings of the Tenth Conference on Machine Translation
Tom Kocmi | Ekaterina Artemova | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Konstantin Dranch | Anton Dvorkovich | Sergey Dukanov | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Marzena Karpinska | Philipp Koehn | Howard Lakougna | Jessica Lundin | Christof Monz | Kenton Murray | Masaaki Nagata | Stefano Perrella | Lorenzo Proietti | Martin Popel | Maja Popović | Parker Riley | Mariya Shmatova | Steinthór Steingrímsson | Lisa Yankovskaya | Vilém Zouhar
Proceedings of the Tenth Conference on Machine Translation
This paper presents the results of the General Machine Translation Task organized as part of the 2025 Conference on Machine Translation (WMT). Participants were invited to build systems for any of 30 language pairs. For half of these pairs, we conducted a human evaluation on test sets spanning four to five different domains.We evaluated 60 systems in total: 36 submitted by participants and 24 for which we collected translations from large language models (LLMs) and popular online translation providers.This year, we focused on creating challenging test sets by developing a difficulty sampling technique and using more complex source data. We evaluated system outputs with professional annotators using the Error Span Annotation (ESA) protocol, except for two language pairs, for which we used Multidimensional Quality Metrics (MQM) instead.We continued the trend of increasingly moving towards document-level translation, providing the source texts as whole documents containing multiple paragraphs.
2024
Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet
Tom Kocmi | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Marzena Karpinska | Philipp Koehn | Benjamin Marie | Christof Monz | Kenton Murray | Masaaki Nagata | Martin Popel | Maja Popović | Mariya Shmatova | Steinthór Steingrímsson | Vilém Zouhar
Proceedings of the Ninth Conference on Machine Translation
Tom Kocmi | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Marzena Karpinska | Philipp Koehn | Benjamin Marie | Christof Monz | Kenton Murray | Masaaki Nagata | Martin Popel | Maja Popović | Mariya Shmatova | Steinthór Steingrímsson | Vilém Zouhar
Proceedings of the Ninth Conference on Machine Translation
This overview paper presents the results of the General Machine Translation Task organised as part of the 2024 Conference on Machine Translation (WMT). In the general MT task, participants were asked to build machine translation systems for any of 11 language pairs, to be evaluated on test sets consisting of three to five different domains. In addition to participating systems, we collected translations from 8 different large language models (LLMs) and 4 online translation providers. We evaluate system outputs with professional human annotators using a new protocol called Error Span Annotations (ESA).
2023
Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet
Tom Kocmi | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Philipp Koehn | Benjamin Marie | Christof Monz | Makoto Morishita | Kenton Murray | Masaaki Nagata | Toshiaki Nakazawa | Martin Popel | Maja Popović | Mariya Shmatova | Jun Suzuki
Proceedings of the Eighth Conference on Machine Translation
Tom Kocmi | Eleftherios Avramidis | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Markus Freitag | Thamme Gowda | Roman Grundkiewicz | Barry Haddow | Philipp Koehn | Benjamin Marie | Christof Monz | Makoto Morishita | Kenton Murray | Masaaki Nagata | Toshiaki Nakazawa | Martin Popel | Maja Popović | Mariya Shmatova | Jun Suzuki
Proceedings of the Eighth Conference on Machine Translation
This paper presents the results of the General Machine Translation Task organised as part of the 2023 Conference on Machine Translation (WMT). In the general MT task, participants were asked to build machine translation systems for any of 8 language pairs (corresponding to 14 translation directions), to be evaluated on test sets consisting of up to four different domains. We evaluate system outputs with professional human annotators using a combination of source-based Direct Assessment and scalar quality metric (DA+SQM).
2022
Findings of the 2022 Conference on Machine Translation (WMT22)
Tom Kocmi | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Thamme Gowda | Yvette Graham | Roman Grundkiewicz | Barry Haddow | Rebecca Knowles | Philipp Koehn | Christof Monz | Makoto Morishita | Masaaki Nagata | Toshiaki Nakazawa | Michal Novák | Martin Popel | Maja Popović
Proceedings of the Seventh Conference on Machine Translation (WMT)
Tom Kocmi | Rachel Bawden | Ondřej Bojar | Anton Dvorkovich | Christian Federmann | Mark Fishel | Thamme Gowda | Yvette Graham | Roman Grundkiewicz | Barry Haddow | Rebecca Knowles | Philipp Koehn | Christof Monz | Makoto Morishita | Masaaki Nagata | Toshiaki Nakazawa | Michal Novák | Martin Popel | Maja Popović
Proceedings of the Seventh Conference on Machine Translation (WMT)
This paper presents the results of the General Machine Translation Task organised as part of the Conference on Machine Translation (WMT) 2022. In the general MT task, participants were asked to build machine translation systems for any of 11 language pairs, to be evaluated on test sets consisting of four different domains. We evaluate system outputs with human annotators using two different techniques: reference-based direct assessment and (DA) and a combination of DA and scalar quality metric (DA+SQM).
2016
Search
Fix author
Co-authors
- Rachel Bawden 5
- Ondřej Bojar 5
- Mark Fishel 5
- Thamme Gowda 5
- Roman Grundkiewicz 5
- Barry Haddow 5
- Tom Kocmi 5
- Philipp Koehn 5
- Christof Monz 5
- Masaaki Nagata 5
- Martin Popel 5
- Maja Popović 5
- Eleftherios Avramidis 4
- Markus Freitag 4
- Kenton Murray 4
- Mariya Shmatova 4
- Sergey Dukanov 3
- Christian Federmann 3
- Steinþór Steingrímsson 3
- Vilém Zouhar 3
- Ekaterina Artemova 2
- Marzena Karpinska 2
- Benjamin Marie 2
- Makoto Morishita 2
- Toshiaki Nakazawa 2
- Stefano Perrella 2
- Lorenzo Proietti 2
- Parker Riley 2
- Lisa Yankovskaya 2
- Konstantin Dranch 1
- Samuel Frontull 1
- Irina Galinskaya 1
- Yvette Graham 1
- Sergey Gubanov 1
- Stan Kharevich 1
- Rebecca Knowles 1
- Howard Lakougna 1
- Zheng Li 1
- Jessica Lundin 1
- Jean Maillard 1
- Alexander Murauski 1
- Michal Novák 1
- Sara Rajaee 1
- Jun Suzuki 1
- Maria Tsyurupa 1