TAMS: Translation-Assisted Morphological Segmentation

Enora Rice, Ali Marashian, Luke Gessler, Alexis Palmer, Katharina Wense


Abstract
Canonical morphological segmentation is the process of analyzing words into the standard (aka underlying) forms of their constituent morphemes.This is a core task in endangered language documentation, and NLP systems have the potential to dramatically speed up this process. In typical language documentation settings, training data for canonical morpheme segmentation is scarce, making it difficult to train high quality models. However, translation data is often much more abundant, and, in this work, we present a method that attempts to leverage translation data in the canonical segmentation task. We propose a character-level sequence-to-sequence model that incorporates representations of translations obtained from pretrained high-resource monolingual language models as an additional signal. Our model outperforms the baseline in a super-low resource setting but yields mixed results on training splits with more data. Additionally, we find that we can achieve strong performance even without needing difficult-to-obtain word level alignments. While further work is needed to make translations useful in higher-resource settings, our model shows promise in severely resource-constrained settings.
Anthology ID:
2024.acl-long.366
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6752–6765
Language:
URL:
https://aclanthology.org/2024.acl-long.366
DOI:
Bibkey:
Cite (ACL):
Enora Rice, Ali Marashian, Luke Gessler, Alexis Palmer, and Katharina Wense. 2024. TAMS: Translation-Assisted Morphological Segmentation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6752–6765, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
TAMS: Translation-Assisted Morphological Segmentation (Rice et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.366.pdf