Super Paths, Better Reasoning: Multi-Hop Knowledge Graphs Reasoning with LLM via Super-Path Ranking and Constraint Verification

Kunpeng Du, Yuhang Zheng, Xiaopeng Li, Chen Gao, Jishu Wang, Rui Zhu, Xuan Zhang


Abstract
Knowledge graph reasoning (KGR) composes multi-hop facts over KGs to support complex knowledge-intensive tasks, providing reliable external factual support for large language models (LLMs) and helping mitigate hallucinations. However, building compact, faithful, and high-quality contexts from large-scale KGs remains challenging. We observe a non-monotonic relationship between retrieval scale and reasoning quality: insufficient retrieval misses critical paths, while excessive retrieval introduces redundant and noisy paths that burden LLMs reasoning. Motivated by this observation, we propose super-path ranking and constraint verification (SPaRC), an efficient framework that constructs, ranks, and verifies super-paths before LLMs reasoning. SPaRC compresses redundant paths into super-paths, ranks them with contrastive learning, verifies top-ranked paths under query semantic constraints, and provides the verified context to the LLMs for answer reasoning. Experiments on WebQSP and CWQ show that SPaRC achieves state-of-the-art performance, improving Hit@1 by up to 12.0 points and F1 by up to 5.9 points on CWQ. On challenging settings covering deeper hop reasoning, multiple topic entities, and multi-answer questions, SPaRC further improves F1 on two benchmarks by up to 17.6% and 42.1%, 26.7% and 5.9%, and 10.4% and 79.4%, respectively, while reducing reasoning tokens by 29.7% and retrieval time by 25%.
Anthology ID:
2026.findings-emnlp.408
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8617–8637
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.408/
DOI:
Bibkey:
Cite (ACL):
Kunpeng Du, Yuhang Zheng, Xiaopeng Li, Chen Gao, Jishu Wang, Rui Zhu, and Xuan Zhang. 2026. Super Paths, Better Reasoning: Multi-Hop Knowledge Graphs Reasoning with LLM via Super-Path Ranking and Constraint Verification. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 8617–8637, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Super Paths, Better Reasoning: Multi-Hop Knowledge Graphs Reasoning with LLM via Super-Path Ranking and Constraint Verification (Du et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.408.pdf