Levi Graph AMR Parser using Heterogeneous Attention

Han He, Jinho D. Choi


Abstract
Coupled with biaffine decoders, transformers have been effectively adapted to text-to-graph transduction and achieved state-of-the-art performance on AMR parsing. Many prior works, however, rely on the biaffine decoder for either or both arc and label predictions although most features used by the decoder may be learned by the transformer already. This paper presents a novel approach to AMR parsing by combining heterogeneous data (tokens, concepts, labels) as one input to a transformer to learn attention, and use only attention matrices from the transformer to predict all elements in AMR graphs (concepts, arcs, labels). Although our models use significantly fewer parameters than the previous state-of-the-art graph parser, they show similar or better accuracy on AMR 2.0 and 3.0.
Anthology ID:
2021.iwpt-1.5
Volume:
Proceedings of the 17th International Conference on Parsing Technologies and the IWPT 2021 Shared Task on Parsing into Enhanced Universal Dependencies (IWPT 2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Stephan Oepen, Kenji Sagae, Reut Tsarfaty, Gosse Bouma, Djamé Seddah, Daniel Zeman
Venue:
IWPT
SIG:
SIGPARSE
Publisher:
Association for Computational Linguistics
Note:
Pages:
50–57
Language:
URL:
https://aclanthology.org/2021.iwpt-1.5
DOI:
10.18653/v1/2021.iwpt-1.5
Bibkey:
Cite (ACL):
Han He and Jinho D. Choi. 2021. Levi Graph AMR Parser using Heterogeneous Attention. In Proceedings of the 17th International Conference on Parsing Technologies and the IWPT 2021 Shared Task on Parsing into Enhanced Universal Dependencies (IWPT 2021), pages 50–57, Online. Association for Computational Linguistics.
Cite (Informal):
Levi Graph AMR Parser using Heterogeneous Attention (He & Choi, IWPT 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.iwpt-1.5.pdf
Video:
 https://aclanthology.org/2021.iwpt-1.5.mp4
Code
 emorynlp/levi-graph-amr-parser
Data
LDC2017T10