Nicholas Khumukcham

Author directory

2026

We describe team PANINI’s submission to the WMT 2026 Shared Task on Low-Resource Indic Language Translation. We submit primary systems for English↔Manipuri (Meiteilon) in both the Bengali (mni Beng) and Meitei Mayek (mni Mtei) scripts, covering all four directions. Rather than one shared multilingual adapter, we train four independent rank-stabilized LoRA (rsLoRA) adapters over IndicTrans2-1B, one per direction. Each adapter is trained on the authentic bitext plus three filtered synthetic streams the model generates for itself: back-translation, forward translation, and iterative pseudo-labelling, with subword regularisation and a script-aware processing pipeline. Our system obtains a COMET score of 92.31 and a BERTScore of 98.85 on English↔Manipuri (Meitei Mayek), the best in the direction. On the into-English directions, it reaches a COMET of 82.90 for mni Beng↔en and 80.20 for mniMtei↔en. These results show that per-direction adapters combined with self-generated synthetic data are effective even when authentic bitext is limited to a few thousand sentence pairs, and that a script-aware processing pipeline is necessary to produce well-formed output in both Manipuri scripts. The code and resources are released on GitHub.
Human evaluation is the gold standard for Natural Language Generation (NLG), but the tooling is fragmented: most platforms serve a single task or a single protocol, and none treat the growing practice of assisting annotators with an LLM as a measurable object of study. These gaps fall hardest on indigenous and under-resourced languages, where paid crowds are scarce, references are unavailable, and data governance matters. We present Aura, an open, self-hostable platform that unifies five evaluation protocols (Likert/DA, pairwise, ranking, error-span, post-editing) across eight task families under one segment schema and one result model, records writing-system and speaker provenance as first-class fields, and runs entirely offline. Its distinguishing feature is a grounded, advisory-only, logged LLM assistant paired with a built-in randomised experiment that estimates the effect of AI assistance on inter-annotator agreement and time-on-task. Aura’s agreement statistics match reference implementations to machine precision. We conducted a human evaluation experiment on three English→Indian-language ranking campaigns (N=9 annotators) which returned a mean usability rating of 4.06/5. Aura is released as open-source software.