Constructing Disambiguated Knowledge Bases from Large Language Models at Scale

Yujia Hu, Tuan-Phong Nguyen, Simon Razniewski


Abstract
Automated Knowledge Base Construction (AKBC) is a core NLP task, and recent work proposes generating knowledge bases directly from large language models (LLMs), treating the model itself as the knowledge source. However, LLMs natively possess no representation of entities, leading to duplicate entries as well as conflations.

We propose DisamKB, a methodology for constructing disambiguated KBs directly from LLMs. DisamKB incorporates on-the-fly disambiguation of entities, relations and classes, and is meticulously designed to satisfy both scalability and disambiguation accuracy. We analyze the central design decisions and characterize the trade-offs between accuracy, scale, and cost. We execute DisamKB at scale, obtaining a materialized KB containing over 1M disambiguated entities and 38.4M triples. This represents the first million-scale LLM-native KB with explicit internal canonicalization of entities, relations, and classes, a significant departure from prior Wikimedia-centric works. DisamKB is anonymously available at https://gptkb.org/.
Anthology ID:
2026.aacl-long.199
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4414–4432
Language:
URL:
https://aclanthology.org/2026.aacl-long.199/
DOI:
Bibkey:
Cite (ACL):
Yujia Hu, Tuan-Phong Nguyen, and Simon Razniewski. 2026. Constructing Disambiguated Knowledge Bases from Large Language Models at Scale. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4414–4432, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
Constructing Disambiguated Knowledge Bases from Large Language Models at Scale (Hu et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.199.pdf