CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation

Chen Tang, Hongbo Zhang, Tyler Loakman, Bohao Yang, Stefan Goetze, Chenghua Lin


Abstract
Commonsense knowledge is crucial to many natural language processing tasks. Existing works usually incorporate graph knowledge with conventional graph neural networks (GNNs), resulting in a sequential pipeline that compartmentalizes the encoding processes for textual and graph-based knowledge. This compartmentalization does, however, not fully exploit the contextual interplay between these two types of input knowledge. In this paper, a novel context-aware graph-attention model (Context-aware GAT) is proposed, designed to effectively assimilate global features from relevant knowledge graphs through a context-enhanced knowledge aggregation mechanism. Specifically, the proposed framework employs an innovative approach to representation learning that harmonizes heterogeneous features by amalgamating flattened graph knowledge with text data. The hierarchical application of graph knowledge aggregation within connected subgraphs, complemented by contextual information, to bolster the generation of commonsense-driven dialogues is analyzed. Empirical results demonstrate that our framework outperforms conventional GNN-based language models in terms of performance. Both, automated and human evaluations affirm the significant performance enhancements achieved by our proposed model over the concept flow baseline.
Anthology ID:
2024.inlg-main.31
Volume:
Proceedings of the 17th International Natural Language Generation Conference
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editors:
Saad Mahamood, Nguyen Le Minh, Daphne Ippolito
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
371–383
Language:
URL:
https://aclanthology.org/2024.inlg-main.31
DOI:
Bibkey:
Cite (ACL):
Chen Tang, Hongbo Zhang, Tyler Loakman, Bohao Yang, Stefan Goetze, and Chenghua Lin. 2024. CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation. In Proceedings of the 17th International Natural Language Generation Conference, pages 371–383, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation (Tang et al., INLG 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.inlg-main.31.pdf