Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation

Chen Tang, Hongbo Zhang, Tyler Loakman, Chenghua Lin, Frank Guerin


Abstract
Incorporating external graph knowledge into neural chatbot models has been proven effective for enhancing dialogue generation. However, in conventional graph neural networks (GNNs), message passing on a graph is independent from text, resulting in the graph representation hidden space differing from that of the text. This training regime of existing models therefore leads to a semantic gap between graph knowledge and text. In this study, we propose a novel framework for knowledge graph enhanced dialogue generation. We dynamically construct a multi-hop knowledge graph with pseudo nodes to involve the language model in feature aggregation within the graph at all steps. To avoid the semantic biases caused by learning on vanilla subgraphs, the proposed framework applies hierarchical graph attention to aggregate graph features on pseudo nodes and then attains a global feature. Therefore, the framework can better utilise the heterogeneous features from both the post and external graph knowledge. Extensive experiments demonstrate that our framework outperforms state-of-the-art (SOTA) baselines on dialogue generation. Further analysis also shows that our representation learning framework can fill the semantic gap by coagulating representations of both text and graph knowledge. Moreover, the language model also learns how to better select knowledge triples for a more informative response via exploiting subgraph patterns within our feature aggregation process. Our code and resources are available at https://github.com/tangg555/SaBART.
Anthology ID:
2023.acl-long.253
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4604–4616
Language:
URL:
https://aclanthology.org/2023.acl-long.253
DOI:
10.18653/v1/2023.acl-long.253
Bibkey:
Cite (ACL):
Chen Tang, Hongbo Zhang, Tyler Loakman, Chenghua Lin, and Frank Guerin. 2023. Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4604–4616, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Enhancing Dialogue Generation via Dynamic Graph Knowledge Aggregation (Tang et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.253.pdf
Video:
 https://aclanthology.org/2023.acl-long.253.mp4