SeeKG: Multi-modal LLMs Understand Knowledge Graphs as Images

Lingbing Guo, Yichi Zhang, Yang Liu, Zhuo Chen, Zequn Sun


Abstract
The representation learning of knowledge graphs (KGs) is a longstanding research problem. While graph neural networks (GNNs) have driven recent progress, they still struggle with encoding textual features and subtle relationships of KGs, particularly in conveying key information to large language models (LLMs). The emergence of multi-modal LLMs (MLLMs), which combine linguistic and visual understanding, presents an intriguing opportunity: Could their vision capabilities inspire mental visualization, facilitating conceptual thinking and semantic reasoning akin to human cognition? To investigate this premise, we propose SeeKG, an innovative framework that transforms KGs into visually rendered representations as image inputs for MLLMs. We evaluate SeeKG under both training-free and supervised fine-tuning settings, where the experimental results show that SeeKG excels in understanding KG sub-graphs and achieves competitive performance even without training or demonstrations. Further fine-tuning on small-batch data reveals that it outperforms state-of-the-art LLM-based methods by substantial margins across multiple KG completion datasets.
Anthology ID:
2026.findings-emnlp.93
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1916–1932
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.93/
DOI:
Bibkey:
Cite (ACL):
Lingbing Guo, Yichi Zhang, Yang Liu, Zhuo Chen, and Zequn Sun. 2026. SeeKG: Multi-modal LLMs Understand Knowledge Graphs as Images. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 1916–1932, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SeeKG: Multi-modal LLMs Understand Knowledge Graphs as Images (Guo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.93.pdf