Tokenization and Morphological Fidelity in Uralic NLP: A Cross-Lingual Evaluation

Nuo Xu, Ahrii Kim


Abstract
Subword tokenization critically affects Natural Language Processing (NLP) performance, yet its behavior in morphologically rich and low-resource language families remains under-explored. This study systematically compares three subword paradigms—Byte Pair Encoding (BPE), Overlap BPE (OBPE), and Unigram Language Model—across six Uralic languages with varying resource availability and typological diversity.Using part-of-speech (POS) tagging as a controlled downstream task, we show that OBPE consistently achieves stronger morphological alignment and higher tagging accuracy than conventional methods, particularly within the Latin-script group. These gains arise from reduced fragmentation in open-class categories and a better balance across the frequency spectrum. Transfer efficacy further depends on the downstream tagging architecture, interacting with both training volume and genealogical proximity.Taken together, these findings highlight that morphology-sensitive tokenization is not merely a preprocessing choice but a decisive factor in enabling effective cross-lingual transfer for agglutinative, low-resource languages.
Anthology ID:
2026.loreslm-1.43
Volume:
Proceedings of the Second Workshop on Language Models for Low-Resource Languages (LoResLM 2026)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Hansi Hettiarachchi, Tharindu Ranasinghe, Alistair Plum, Paul Rayson, Ruslan Mitkov, Mohamed Gaber, Damith Premasiri, Fiona Anting Tan, Lasitha Uyangodage
Venue:
LoResLM
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
493–503
Language:
URL:
https://aclanthology.org/2026.loreslm-1.43/
DOI:
Bibkey:
Cite (ACL):
Nuo Xu and Ahrii Kim. 2026. Tokenization and Morphological Fidelity in Uralic NLP: A Cross-Lingual Evaluation. In Proceedings of the Second Workshop on Language Models for Low-Resource Languages (LoResLM 2026), pages 493–503, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
Tokenization and Morphological Fidelity in Uralic NLP: A Cross-Lingual Evaluation (Xu & Kim, LoResLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.loreslm-1.43.pdf