Toward End-to-End Open-Weight LLM-RBMT for Endangered Languages

Jared Coleman, Bhaskar Krishnamachari


Abstract
We present an end-to-end open-weight pipeline for LLM-Assisted Rule-Based Machine Translation (LLM-RBMT) into extremely low-resource languages, with no proprietary-API dependency at any stage and no per-language linguistic effort beyond registering a language with the framework. On Owens Valley Paiute (OVP), a critically endangered Indigenous language of California, we synthesize training data entirely from the OVP language specification, fine-tune two Qwen2.5-3B LoRA adapters (one for each LLM-driven stage of the translation system), and serve both locally. The fine-tuned forward adapter matches or exceeds gpt-4o-mini on the 150-sentence forward evaluation of Coleman et al. (2026) (COMET-c 0.472 vs. 0.448, same evaluator), and a separately fine-tuned backward adapter approaches it on a 40-item hand-validated backward reference set, both running locally. The full recipe runs on a single consumer GPU.
Anthology ID:
2026.emnlp-main.1832
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
41703–41714
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1832/
DOI:
Bibkey:
Cite (ACL):
Jared Coleman and Bhaskar Krishnamachari. 2026. Toward End-to-End Open-Weight LLM-RBMT for Endangered Languages. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 41703–41714, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Toward End-to-End Open-Weight LLM-RBMT for Endangered Languages (Coleman & Krishnamachari, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1832.pdf