AMR Parsing via Graph-Sequence Iterative Inference

Deng Cai, Wai Lam


Abstract
We propose a new end-to-end model that treats AMR parsing as a series of dual decisions on the input sequence and the incrementally constructed graph. At each time step, our model performs multiple rounds of attention, reasoning, and composition that aim to answer two critical questions: (1) which part of the input sequence to abstract; and (2) where in the output graph to construct the new concept. We show that the answers to these two questions are mutually causalities. We design a model based on iterative inference that helps achieve better answers in both perspectives, leading to greatly improved parsing accuracy. Our experimental results significantly outperform all previously reported Smatch scores by large margins. Remarkably, without the help of any large-scale pre-trained language model (e.g., BERT), our model already surpasses previous state-of-the-art using BERT. With the help of BERT, we can push the state-of-the-art results to 80.2% on LDC2017T10 (AMR 2.0) and 75.4% on LDC2014T12 (AMR 1.0).
Anthology ID:
2020.acl-main.119
Volume:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2020
Address:
Online
Editors:
Dan Jurafsky, Joyce Chai, Natalie Schluter, Joel Tetreault
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1290–1301
Language:
URL:
https://aclanthology.org/2020.acl-main.119
DOI:
10.18653/v1/2020.acl-main.119
Bibkey:
Cite (ACL):
Deng Cai and Wai Lam. 2020. AMR Parsing via Graph-Sequence Iterative Inference. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1290–1301, Online. Association for Computational Linguistics.
Cite (Informal):
AMR Parsing via Graph-Sequence Iterative Inference (Cai & Lam, ACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.acl-main.119.pdf
Video:
 http://slideslive.com/38928981
Code
 jcyk/AMR-gs +  additional community code
Data
LDC2017T10