Nathanial Paul Ekberg
Author directory2026
Omnilingual MT: Machine Translation for 1,600 Languages
Belen Alastruey | Niyati Bafna | Andrea Caciolai | Kevin Heffernan | Artyom Kozhevnikov | Christophe Ropers | Eduardo Sánchez | Charles-Éric Saint-James | Ioannis Tsiamas | Xiang Tony Cao | Chierh Cheng | Joe Chuang | Paul-Ambroise Duquenne | Mark Duppenthaler | Cynthia Gao | Pere-Lluís Huguet Cabot | João Maria Janeiro | Jean Maillard | Gabriel Eduardo Mejia-Gonzalez | Holger Schwenk | Edan Toledo | Arina Turkatenko | Albert Ventayol-Boada | Ravi Arikapudi | Nathanial Paul Ekberg | Rashel Moritz | Alexandre Mourachko | Surya Parimi | Mary Williamson | Shireen Yates | David Dale | Marta R. Costa-jussà
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Belen Alastruey | Niyati Bafna | Andrea Caciolai | Kevin Heffernan | Artyom Kozhevnikov | Christophe Ropers | Eduardo Sánchez | Charles-Éric Saint-James | Ioannis Tsiamas | Xiang Tony Cao | Chierh Cheng | Joe Chuang | Paul-Ambroise Duquenne | Mark Duppenthaler | Cynthia Gao | Pere-Lluís Huguet Cabot | João Maria Janeiro | Jean Maillard | Gabriel Eduardo Mejia-Gonzalez | Holger Schwenk | Edan Toledo | Arina Turkatenko | Albert Ventayol-Boada | Ravi Arikapudi | Nathanial Paul Ekberg | Rashel Moritz | Alexandre Mourachko | Surya Parimi | Mary Williamson | Shireen Yates | David Dale | Marta R. Costa-jussà
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
We introduce Omnilingual MT, a family of multilingual translation (MT) systems covering more than 1,600 languages—the broadest benchmarked coverage of any MT system to date. We make contributions in several key research questions in the field: strategies for the use of monolingual data, curating seed training data, tokenization and suitable architectures, the competitiveness of small specialized MT models as opposed to general purpose large models, and evaluation protocols. Our data strategy combines large-scale multilingual corpora with backtranslation for 2,000+ languages and MeDLEy, a grammatically-diverse seed dataset for 109 low-resource languages. We explore two complementary architectures: OMT-LLAMA, a decoder-only model (1B/3B/8B) built on LLAMA3 with multilingual continual pretraining, and OMT-NLLB, a 3B encoder-decoder model with a novel three-stage training strategy exploiting non-parallel data via autoencoding. For evaluation, we extend the BOUQuET benchmark to 275 languages, develop Met-BOUQuET with human annotations of machine quality in 161 directions, and BLASER 3, a reference-free quality estimation metric. Our specialized 1B–8B models match or exceed 70B general-purpose LLMs, demonstrating that specialization is a more reliable path to multilingual translation than scale alone. Omnilingual MT achieves “passable” translation quality as judged by human annotators for over 440 languages, doubling it over the previous state of the field at ∼200 languages, and translates in zero-shot mode into ∼1,200 languages versus 300–400 for the baselines. With Omnilingual MT, we showcase a path encompassing the full pipeline of data and system development towards designing models that are multilingual from the onset.
2025
BOUQuET : dataset, Benchmark and Open initiative for Universal Quality Evaluation in Translation
Pierre Andrews | Mikel Artetxe | Mariano Coria Meglioli | Marta R. Costa-jussà | Joe Chuang | David Dale | Mark Duppenthaler | Nathanial Paul Ekberg | Cynthia Gao | Daniel Edward Licht | Jean Maillard | Alexandre Mourachko | Christophe Ropers | Safiyyah Saleem | Eduardo Sánchez | Ioannis Tsiamas | Arina Turkatenko | Albert Ventayol-Boada | Shireen Yates
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Pierre Andrews | Mikel Artetxe | Mariano Coria Meglioli | Marta R. Costa-jussà | Joe Chuang | David Dale | Mark Duppenthaler | Nathanial Paul Ekberg | Cynthia Gao | Daniel Edward Licht | Jean Maillard | Alexandre Mourachko | Christophe Ropers | Safiyyah Saleem | Eduardo Sánchez | Ioannis Tsiamas | Arina Turkatenko | Albert Ventayol-Boada | Shireen Yates
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
BOUQuET is a multi-way, multicentric and multi-register/domain dataset and benchmark, and a broader collaborative initiative. This dataset is handcrafted in 8 non-English languages (i.e. Egyptian Arabic and Modern Standard Arabic, French, German, Hindi, Indonesian, Mandarin Chinese, Russian, and Spanish). Each of these source languages are representative of the most widely spoken ones and therefore they have the potential to serve as pivot languages that will enable more accurate translations. The dataset is multicentric to enforce representation of multilingual language features. In addition, the dataset goes beyond the sentence level, as it is organized in paragraphs of various lengths. Compared with related machine translation datasets, we show that BOUQuET has a broader representation of domains while simplifying the translation task for non-experts. Therefore, BOUQuET is specially suitable for crowd-source extension for which we are launching a call aim-ing at collecting a multi-way parallel corpus covering any written language. The dataset is freely available at https://huggingface.co/datasets/facebook/bouquet.
Search
Fix author
Co-authors
- Joe Chuang 2
- Marta R. Costa-jussà 2
- David Dale 2
- Mark Duppenthaler 2
- Cynthia Gao 2
- Jean Maillard 2
- Alexandre Mourachko 2
- Christophe Ropers 2
- Eduardo Sánchez 2
- Ioannis Tsiamas 2
- Arina Turkatenko 2
- Albert Ventayol-Boada 2
- Shireen Yates 2
- Belen Alastruey 1
- Pierre Andrews 1
- Ravi Arikapudi 1
- Mikel Artetxe 1
- Niyati Bafna 1
- Andrea Caciolai 1
- Xiang Tony Cao 1
- Chierh Cheng 1
- Paul-Ambroise Duquenne 1
- Kevin Heffernan 1
- Pere-Lluís Huguet Cabot 1
- João Maria Janeiro 1
- Artyom Kozhevnikov 1
- Daniel Edward Licht 1
- Mariano Coria Meglioli 1
- Gabriel Eduardo Mejia-Gonzalez 1
- Rashel Moritz 1
- Surya Parimi 1
- Charles-Éric Saint-James 1
- Safiyyah Saleem 1
- Holger Schwenk 1
- Edan Toledo 1
- Mary Williamson 1