Koj Sambyo

Author directory

2026

This paper presents the findings of the Lowresource Indic Languages Translation Shared Task organized at the Eleventh Conference on Machine Translation (WMT 2026). We evaluated machine translation systems across ten English–Indic language pairs spanning three major language families of Northeast India, grouped into moderately resourced and extremely low-resource categories. Built upon the expanded INDICNE-CORP 2.0 dataset, this edition introduced a rigorous, bidirectional multidomain benchmark covering the Healthcare, Political, Travel, Sports, and Entertainment domains to assess real-world generalizability. The task attracted 24 participating teams who deployed diverse methodologies, including parameter-efficient fine-tuning (PEFT) of multilingual foundations, retrieval-augmented generation (RAG) using frontier large language models (LLMs), and hybrid neuro-symbolic decoding constraints. The systems were evaluated using a comprehensive suite of lexical metrics (BLEU, METEOR, TER, ChrF++) and semantic metrics (BERTScore, COMET). Our analysis reveals a persistent performance cliff under extreme data scarcity and a pronounced directional asymmetry, demonstrating that while current architectures readily decode Indic representations into English, they struggle to generate morphologically complex Indic target text. By publicly releasing these datasets, evaluation protocols, and competitive baselines, this shared task establishes a foundation for advancing research in translation technologies for underrepresented and indigenous languages.

2025

This study proposes the results of the lowresource Indic language translation task organized in collaboration with the Tenth Conference on Machine Translation (WMT) 2025. In this workshop, participants were required to build and develop machine translation models for the seven language pairs, which were categorized into two categories. Category 1 is moderate training data available in languages i.e English–Assamese, English–Mizo, English-Khasi, English–Manipuri and English– Nyishi. Category 2 has very limited training data available in languages, i.e English–Bodo and English–Kokborok. This task leverages the enriched IndicNE-corp1.0 dataset, which consists of an extensive collection of parallel and monilingual corpora for north eastern Indic languages. The participant results were evaluated using automatic machine translation metrics, including BLEU, TER, ROUGE-L, ChrF, and METEOR. Along with those metrics, this year’s work also includes Cosine similarity for evaluation, which captures the semantic representation of the sentence to measure the performance and accuracy of the models. This work aims to promote innovation and advancements in low-resource Indic languages.