On the (In)effectiveness of AMR Augmentation for Large Language Models

Hoa Quynh Nhung Nguyen, Jacopo Staiano, Michael Sullivan


Abstract
While Abstract Meaning Representation (AMR) has historically improved performance on a range of NLP tasks, the benefit—or lack thereof—of AMR augmentation for modern LLMs is thus far unclear. In this paper, we attempt to reproduce recent work that reported substantial downstream gains from AMR augmentation, finding that these are likely due to specific choices in the experimental settings used: using a consistent and unified protocol for hyperparameter selection, we observe that text-only baselines consistently match or exceed the performance of AMR-augmented models. To investigate this null result, we introduce a perplexity-based probe measuring the degree to which AMR provides an LLM with supplemental relational knowledge not already available to the model. We find that AMR augmentation does not help LLMs improve their understanding of relational content in the sentence, indicating that augmenting these models with AMR offers no clear benefit on downstream tasks.
Anthology ID:
2026.emnlp-main.754
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17428–17450
Language:
URL:
https://aclanthology.org/2026.emnlp-main.754/
DOI:
Bibkey:
Cite (ACL):
Hoa Quynh Nhung Nguyen, Jacopo Staiano, and Michael Sullivan. 2026. On the (In)effectiveness of AMR Augmentation for Large Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 17428–17450, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
On the (In)effectiveness of AMR Augmentation for Large Language Models (Nguyen et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.754.pdf