CWoMP: Morpheme Representation Learning for Interlinear Glossing

Morris Alper, Enora Rice, Bhargav Shandilya, Alexis Palmer, Lori Levin


Abstract
Interlinear glossed text (IGT) is a standard notation for language documentation which is linguistically rich but laborious to produce manually. Recent automated IGT methods treat glosses as character sequences, neglecting their compositional structure. We propose CWoMP (Contrastive Word-Morpheme Pretraining), which instead treats morphemes as atomic form-meaning units with learned representations. A contrastively trained encoder aligns words-in-context with their constituent morphemes in a shared embedding space; an autoregressive decoder then generates the morpheme sequence by retrieving entries from a mutable lexicon of these embeddings. Predictions are interpretable–grounded in lexicon entries–and users can improve results at inference time by expanding the lexicon without retraining. We evaluate on diverse low-resource languages, showing that CWoMP outperforms existing methods while being significantly more efficient, with particularly strong gains in extremely low-resource settings.
Anthology ID:
2026.emnlp-main.675
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15535–15552
Language:
URL:
https://aclanthology.org/2026.emnlp-main.675/
DOI:
Bibkey:
Cite (ACL):
Morris Alper, Enora Rice, Bhargav Shandilya, Alexis Palmer, and Lori Levin. 2026. CWoMP: Morpheme Representation Learning for Interlinear Glossing. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 15535–15552, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CWoMP: Morpheme Representation Learning for Interlinear Glossing (Alper et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.675.pdf