Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting

Katharina Kann, Hinrich Schütze


Abstract
Neural state-of-the-art sequence-to-sequence (seq2seq) models often do not perform well for small training sets. We address paradigm completion, the morphological task of, given a partial paradigm, generating all missing forms. We propose two new methods for the minimal-resource setting: (i) Paradigm transduction: Since we assume only few paradigms available for training, neural seq2seq models are able to capture relationships between paradigm cells, but are tied to the idiosyncracies of the training set. Paradigm transduction mitigates this problem by exploiting the input subset of inflected forms at test time. (ii) Source selection with high precision (SHIP): Multi-source models which learn to automatically select one or multiple sources to predict a target inflection do not perform well in the minimal-resource setting. SHIP is an alternative to identify a reliable source if training data is limited. On a 52-language benchmark dataset, we outperform the previous state of the art by up to 9.71% absolute accuracy.
Anthology ID:
D18-1363
Volume:
Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
Month:
October-November
Year:
2018
Address:
Brussels, Belgium
Editors:
Ellen Riloff, David Chiang, Julia Hockenmaier, Jun’ichi Tsujii
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3254–3264
Language:
URL:
https://aclanthology.org/D18-1363
DOI:
10.18653/v1/D18-1363
Bibkey:
Cite (ACL):
Katharina Kann and Hinrich Schütze. 2018. Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 3254–3264, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Neural Transductive Learning and Beyond: Morphological Generation in the Minimal-Resource Setting (Kann & Schütze, EMNLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/D18-1363.pdf
Attachment:
 D18-1363.Attachment.zip
Video:
 https://aclanthology.org/D18-1363.mp4