A Morpho-Syntactically Informed LSTM-CRF Model for Named Entity Recognition

Lilia Simeonova, Kiril Simov, Petya Osenova, Preslav Nakov


Abstract
We propose a morphologically informed model for named entity recognition, which is based on LSTM-CRF architecture and combines word embeddings, Bi-LSTM character embeddings, part-of-speech (POS) tags, and morphological information. While previous work has focused on learning from raw word input, using word and character embeddings only, we show that for morphologically rich languages, such as Bulgarian, access to POS information contributes more to the performance gains than the detailed morphological information. Thus, we show that named entity recognition needs only coarse-grained POS tags, but at the same time it can benefit from simultaneously using some POS information of different granularity. Our evaluation results over a standard dataset show sizeable improvements over the state-of-the-art for Bulgarian NER.
Anthology ID:
R19-1127
Volume:
Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019)
Month:
September
Year:
2019
Address:
Varna, Bulgaria
Editors:
Ruslan Mitkov, Galia Angelova
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd.
Note:
Pages:
1104–1113
Language:
URL:
https://aclanthology.org/R19-1127
DOI:
10.26615/978-954-452-056-4_127
Bibkey:
Cite (ACL):
Lilia Simeonova, Kiril Simov, Petya Osenova, and Preslav Nakov. 2019. A Morpho-Syntactically Informed LSTM-CRF Model for Named Entity Recognition. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP 2019), pages 1104–1113, Varna, Bulgaria. INCOMA Ltd..
Cite (Informal):
A Morpho-Syntactically Informed LSTM-CRF Model for Named Entity Recognition (Simeonova et al., RANLP 2019)
Copy Citation:
PDF:
https://aclanthology.org/R19-1127.pdf