Hunter Scheppat

Author directory

2026

While the quality of machine translation (MT) between widely-spoken languages has improved dramatically in recent years, training robust MT systems for languages with fewer resources remains a challenge. Endangered languages, which often lack the speaker population and written tradition needed to create text resources, are at a particular disadvantage. Developing robust MT architectures for very low-resource settings is hampered by the lack of suitable parallel corpora. To address this challenge, we introduce FormosanMT, a set of MT-ready parallel corpora for the Formosan family of endangered languages indigenous to Taiwan. Together the corpora total nearly 500,000 Formosan-Mandarin and Formosan-English sentence pairs. We share scripts for extracting these corpora from public sources, along with customizable tools for filtering, normalizing, and partitioning the data. In addition, we provide a new tokenizer for Traditional Chinese writing compatible with the popular No Language Left Behind (NLLB) MT architecture, along with updated and improved code for fine-tuning NLLB for any low-resource language pair. Finally we distribute our fully trained NLLB and OpenNMT models for the Formosan languages to and from both Mandarin and English. In addition to serving as a valuable resource for the Formosan language speaker communities, our data, code, and models will be available to NLP researchers working on endangered and low-resource language MT.
Recent work on ASR for endangered languages has focused on fine-tuning a pretrained multilingual model to a small amount of data in the target language, but even with large and diverse pretrained models, error rates can be stubbornly high. Including additional data from the target language can yield improvements, but acquiring this kind of data for endangered languages is challenging. One commonly proposed alternative is to leverage data in a more highly resourced language from the same language family, but there has been remarkably little work evaluating the real-world utility of this practice. In this short paper, we explore the relevance of phylogenetic relatedness of transfer data for improving ASR for endangered languages with minimal training resources. We find, unexpectedly, that augmenting with unrelated donor language data improves word error rate (WER) more than related language data. In addition, the performance improvement observed via transfer of unrelated data is larger than that observed when nearly doubling the quantity of in-language training data. These surprising results hold even when controlling for factors such as acoustic similarity, audio quality, and subword overlap. Our findings point the way to practical new approaches for improving ASR for endangered languages.

2025

Machine translation (MT) can be a useful technology for language documentation and for promoting language use in endangered language communities. Few endangered languages, however, have an existing parallel corpus large enough to train a reasonable MT model. In this paper, we re-purpose a wide range of diverse data sources containing Amis, English, and Mandarin text to serve as parallel corpora for training MT systems for Amis, one of the Indigenous languages of Taiwan. To supplement the small amount of Amis-English data, we produce synthetic Amis-English data by using a high quality MT system to generate English translations for the Mandarin side of the Amis-Mandarin corpus. Using two popular neural MT systems, OpenNMT and NLLB, we train models to translate between English and Amis, and Mandarin and Amis. We find that including synthetic data is helpful only when translating to English. In addition, we observe that neither MT architecture is consistently superior to other and that performance seems to vary according to the direction of translation and the amount of data used. These results indicate that MT is possible for an under-resourced language even without a formally prepared parallel corpus, but multiple training methods should be explored to produce optimal results.