Ali Kuzhuget
2025
SMOL: Professionally Translated Parallel Data for 115 Under-represented Languages
Isaac Caswell | Elizabeth Nielsen | Jiaming Luo | Colin Cherry | Geza Kovacs | Hadar Shemtov | Partha Talukdar | Dinesh Tewari | Baba Mamadi Diane | Djibrila Diane | Solo Farabado Cissé | Koulako Moussa Doumbouya | Edoardo Ferrante | Alessandro Guasoni | Christopher Homan | Mamadou K. Keita | Sudhamoy DebBarma | Ali Kuzhuget | David Anugraha | Muhammad Ravi Shulthan Habibi | Sina Ahmadi | Anthony Munthali | Jonathan Mingfei Liu | Jonathan Eng
Proceedings of the Tenth Conference on Machine Translation
Isaac Caswell | Elizabeth Nielsen | Jiaming Luo | Colin Cherry | Geza Kovacs | Hadar Shemtov | Partha Talukdar | Dinesh Tewari | Baba Mamadi Diane | Djibrila Diane | Solo Farabado Cissé | Koulako Moussa Doumbouya | Edoardo Ferrante | Alessandro Guasoni | Christopher Homan | Mamadou K. Keita | Sudhamoy DebBarma | Ali Kuzhuget | David Anugraha | Muhammad Ravi Shulthan Habibi | Sina Ahmadi | Anthony Munthali | Jonathan Mingfei Liu | Jonathan Eng
Proceedings of the Tenth Conference on Machine Translation
We open-source SMOL (Set of Maximal Over-all Leverage), a suite of training data to un-lock machine translation for low-resource languages (LRLs). SMOL has been translated into123 under-resourced languages (125 language pairs), including many for which there exist no previous public resources, for a total of 6.1M translated tokens. SMOL comprises two sub-datasets, each carefully chosen for maximum impact given its size: SMOLSENT, a set of sentences chosen for broad unique token coverage, and SMOLDOC, a document-level source focusing on a broad topic coverage. They join the already released GATITOS for a trifecta of paragraph, sentence, and token-level content. We demonstrate that using SMOL to prompt or fine-tune Large Language Models yields robust chrF improvements. In addition to translation, we provide factuality ratings and rationales for all documents in SMOLDOC, yielding the first factuality datasets for most of these languages.
2024
Enhancing Tuvan Language Resources through the FLORES Dataset
Ali Kuzhuget | Airana Mongush | Nachyn-Enkhedorzhu Oorzhak
Proceedings of the Ninth Conference on Machine Translation
Ali Kuzhuget | Airana Mongush | Nachyn-Enkhedorzhu Oorzhak
Proceedings of the Ninth Conference on Machine Translation
FLORES is a benchmark dataset designed for evaluating machine translation systems, partic- ularly for low-resource languages. This paper, conducted as a part of Open Language Data Ini- tiative (OLDI) shared task, presents our contri- bution to expanding the FLORES dataset with high-quality translations from Russian to Tu- van, an endangered Turkic language. Our ap- proach combined the linguistic expertise of na- tive speakers to ensure both accuracy and cul- tural relevance in the translations. This project represents a significant step forward in support- ing Tuvan as a low-resource language in the realm of natural language processing (NLP) and machine translation (MT).
Search
Fix author
Co-authors
- Sina Ahmadi 1
- David Anugraha 1
- Isaac Caswell 1
- Colin Cherry 1
- Solo Farabado Cissé 1
- Sudhamoy DebBarma 1
- Baba Mamadi Diané 1
- Djibrila Diané 1
- Koulako Moussa Doumbouya 1
- Jonathan Eng 1
- Edoardo Ferrante 1
- Alessandro Guasoni 1
- Muhammad Ravi Shulthan Habibi 1
- Christopher Homan 1
- Mamadou K. Keita 1
- Geza Kovacs 1
- Jonathan Mingfei Liu 1
- Jiaming Luo 1
- Airana Mongush 1
- Anthony Munthali 1
- Elizabeth Nielsen 1
- Nachyn-Enkhedorzhu Oorzhak 1
- Hadar Shemtov 1
- Partha Talukdar 1
- Dinesh Tewari 1