Structure-aware Knowledge Graph-to-text Generation with Planning Selection and Similarity Distinction

Feng Zhao, Hongzhi Zou, Cheng Yan


Abstract
The knowledge graph-to-text (KG-to-text) generation task aims to synthesize coherent and engaging sentences that accurately convey the complex information derived from an input knowledge graph. One of the primary challenges in this task is bridging the gap between the diverse structures of the KG and the target text, while preserving the details of the input KG. To address this, we propose a novel approach that efficiently integrates graph structure-aware modules with pre-trained language models. Unlike conventional techniques, which only consider direct connections between first-order neighbors, our method delves deeper by incorporating Relative Distance Encoding as a bias within the graph structure-aware module. This enables our model to better capture the intricate topology information present in the KG. To further elevate the fidelity of the generated text, Planning Selection and Similarity Distinction are introduced. Our approach filters the most relevant linearized sequences by employing a planning scorer, while simultaneously distinguishing similar input KGs through contrastive learning techniques. Experiments on two datasets demonstrate the superiority of our model.
Anthology ID:
2023.emnlp-main.537
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8693–8703
Language:
URL:
https://aclanthology.org/2023.emnlp-main.537
DOI:
10.18653/v1/2023.emnlp-main.537
Bibkey:
Cite (ACL):
Feng Zhao, Hongzhi Zou, and Cheng Yan. 2023. Structure-aware Knowledge Graph-to-text Generation with Planning Selection and Similarity Distinction. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 8693–8703, Singapore. Association for Computational Linguistics.
Cite (Informal):
Structure-aware Knowledge Graph-to-text Generation with Planning Selection and Similarity Distinction (Zhao et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.537.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.537.mp4