Tree-Stack LSTM in Transition Based Dependency Parsing

Ömer Kırnap, Erenay Dayanık, Deniz Yuret


Abstract
We introduce tree-stack LSTM to model state of a transition based parser with recurrent neural networks. Tree-stack LSTM does not use any parse tree based or hand-crafted features, yet performs better than models with these features. We also develop new set of embeddings from raw features to enhance the performance. There are 4 main components of this model: stack’s σ-LSTM, buffer’s β-LSTM, actions’ LSTM and tree-RNN. All LSTMs use continuous dense feature vectors (embeddings) as an input. Tree-RNN updates these embeddings based on transitions. We show that our model improves performance with low resource languages compared with its predecessors. We participate in CoNLL 2018 UD Shared Task as the “KParse” team and ranked 16th in LAS, 15th in BLAS and BLEX metrics, of 27 participants parsing 82 test sets from 57 languages.
Anthology ID:
K18-2012
Volume:
Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
Month:
October
Year:
2018
Address:
Brussels, Belgium
Editors:
Daniel Zeman, Jan Hajič
Venue:
CoNLL
SIG:
SIGNLL
Publisher:
Association for Computational Linguistics
Note:
Pages:
124–132
Language:
URL:
https://aclanthology.org/K18-2012
DOI:
10.18653/v1/K18-2012
Bibkey:
Cite (ACL):
Ömer Kırnap, Erenay Dayanık, and Deniz Yuret. 2018. Tree-Stack LSTM in Transition Based Dependency Parsing. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pages 124–132, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
Tree-Stack LSTM in Transition Based Dependency Parsing (Kırnap et al., CoNLL 2018)
Copy Citation:
PDF:
https://aclanthology.org/K18-2012.pdf
Code
 kirnap/ku-dependency-parser2