Chain of Knowledge Graph: Information-Preserving Multi-Document Summarization for Noisy Documents

Kangil Lee, Jinwoo Jang, Youngjin Lim, Minsu Shin


Abstract
With the advent of large language models, the complexity of multi-document summarization task has been substantially reduced. The summarization process must effectively handle noisy documents that are irrelevant to the main topic while preserving essential information. Recently, Chain-of-Density (COD) and Chain-of-Event (CoE) have proposed prompts to effectively handle the noisy documents by using entity-centric approaches for the summarization. However, CoD and CoE are prone to information loss during entity extraction due to their tendency to overly filter out entities perceived as less critical but that could still be important. In this paper, we propose a novel instruction prompt termed as Chain of Knowledge Graph (CoKG) for multi-document summarization. Our prompt extracts entities and constructs relationships between entities to form a Knowledge Graph (KG). Next, the prompt enriches these relationships to recognize potentially important entities and assess the strength of each relation. If the acquired KG meets a predefined quality level, the KG is used to summarize the given documents. This process helps alleviate the information loss in multi-document summarization. Experimental results demonstrate that our prompt effectively preserves key entities and is robust to noisy documents.
Anthology ID:
2025.neusymbridge-1.1
Volume:
Proceedings of Bridging Neurons and Symbols for Natural Language Processing and Knowledge Graphs Reasoning @ COLING 2025
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Kang Liu, Yangqiu Song, Zhen Han, Rafet Sifa, Shizhu He, Yunfei Long
Venues:
NeusymBridge | WS
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
1–5
Language:
URL:
https://aclanthology.org/2025.neusymbridge-1.1/
DOI:
Bibkey:
Cite (ACL):
Kangil Lee, Jinwoo Jang, Youngjin Lim, and Minsu Shin. 2025. Chain of Knowledge Graph: Information-Preserving Multi-Document Summarization for Noisy Documents. In Proceedings of Bridging Neurons and Symbols for Natural Language Processing and Knowledge Graphs Reasoning @ COLING 2025, pages 1–5, Abu Dhabi, UAE. ELRA and ICCL.
Cite (Informal):
Chain of Knowledge Graph: Information-Preserving Multi-Document Summarization for Noisy Documents (Lee et al., NeusymBridge 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.neusymbridge-1.1.pdf