A Pointer Network Architecture for Joint Morphological Segmentation and Tagging

Amit Seker, Reut Tsarfaty


Abstract
Morphologically Rich Languages (MRLs) such as Arabic, Hebrew and Turkish often require Morphological Disambiguation (MD), i.e., the prediction of morphological decomposition of tokens into morphemes, early in the pipeline. Neural MD may be addressed as a simple pipeline, where segmentation is followed by sequence tagging, or as an end-to-end model, predicting morphemes from raw tokens. Both approaches are sub-optimal; the former is heavily prone to error propagation, and the latter does not enjoy explicit access to the basic processing units called morphemes. This paper offers MD architecture that combines the symbolic knowledge of morphemes with the learning capacity of neural end-to-end modeling. We propose a new, general and easy-to-implement Pointer Network model where the input is a morphological lattice and the output is a sequence of indices pointing at a single disambiguated path of morphemes. We demonstrate the efficacy of the model on segmentation and tagging, for Hebrew and Turkish texts, based on their respective Universal Dependencies (UD) treebanks. Our experiments show that with complete lattices, our model outperforms all shared-task results on segmenting and tagging these languages. On the SPMRL treebank, our model outperforms all previously reported results for Hebrew MD in realistic scenarios.
Anthology ID:
2020.findings-emnlp.391
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4368–4378
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.391
DOI:
10.18653/v1/2020.findings-emnlp.391
Bibkey:
Cite (ACL):
Amit Seker and Reut Tsarfaty. 2020. A Pointer Network Architecture for Joint Morphological Segmentation and Tagging. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4368–4378, Online. Association for Computational Linguistics.
Cite (Informal):
A Pointer Network Architecture for Joint Morphological Segmentation and Tagging (Seker & Tsarfaty, Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.391.pdf
Data
Universal Dependencies