Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey

Garima Agrawal, Tharindu Kumarage, Zeyad Alghamdi, Huan Liu


Abstract
The contemporary LLMs are prone to producing hallucinations, stemming mainly from the knowledge gaps within the models. To address this critical limitation, researchers employ diverse strategies to augment the LLMs by incorporating external knowledge, aiming to reduce hallucinations and enhance reasoning accuracy. Among these strategies, leveraging knowledge graphs as a source of external information has demonstrated promising results. In this survey, we comprehensively review these knowledge-graph-based augmentation techniques in LLMs, focusing on their efficacy in mitigating hallucinations. We systematically categorize these methods into three overarching groups, offering methodological comparisons and performance evaluations. Lastly, this survey explores the current trends and challenges associated with these techniques and outlines potential avenues for future research in this emerging field.
Anthology ID:
2024.naacl-long.219
Volume:
Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
Month:
June
Year:
2024
Address:
Mexico City, Mexico
Editors:
Kevin Duh, Helena Gomez, Steven Bethard
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3947–3960
Language:
URL:
https://aclanthology.org/2024.naacl-long.219
DOI:
10.18653/v1/2024.naacl-long.219
Bibkey:
Cite (ACL):
Garima Agrawal, Tharindu Kumarage, Zeyad Alghamdi, and Huan Liu. 2024. Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 3947–3960, Mexico City, Mexico. Association for Computational Linguistics.
Cite (Informal):
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey (Agrawal et al., NAACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.naacl-long.219.pdf