ARTKGC: Leakage-Controlled Multimodal Knowledge Graph Completion for Artwork Explanation

Xuan Zhou, Xuefeng Wei, Yuta Kato, Shintaro Ozaki, Kazuki Hayashi, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, Taro Watanabe


Abstract
Explaining an artwork requires knowledge beyond visual recognition, including facts about its creator, subject, material, style, collection, and historical context. Knowledge graphs can provide such evidence, but artwork KGs are incomplete, especially for newly encountered artworks. We introduce ArtKGC, a leakage-controlled multimodal benchmark and evaluation protocol for artwork knowledge graph completion. ArtKGC links artworks to Wikidata facts, Wikipedia descriptions, and visual evidence while controlling ambiguous mappings, graph leakage, and descriptions that directly reveal held-out answers. We show that graph-only models are weak for unseen artworks, raw text can inflate evaluation through answer leakage, and visual evidence is strongly relation-dependent. As an interpretable diagnostic baseline, we use a validation-calibrated reranker that combines structural, sentence-redacted textual, and visual evidence. Experiments show improved completion in the primary inductive-artwork setting and modest downstream evidence gains for artwork QA and explanation diagnostics.
Anthology ID:
2026.findings-emnlp.2299
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
49291–49309
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2299/
DOI:
Bibkey:
Cite (ACL):
Xuan Zhou, Xuefeng Wei, Yuta Kato, Shintaro Ozaki, Kazuki Hayashi, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, and Taro Watanabe. 2026. ARTKGC: Leakage-Controlled Multimodal Knowledge Graph Completion for Artwork Explanation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 49291–49309, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ARTKGC: Leakage-Controlled Multimodal Knowledge Graph Completion for Artwork Explanation (Zhou et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2299.pdf