PredNav: A Predictive Cognitive Map for Zero-Shot Object Goal Navigation

Qingao Chai, Jiashuo Wang, Rui Yan, Huajin Tang


Abstract
Zero-shot Object Goal Navigation requires an embodied agent to locate a target object in an unseen environment, where the choice of which frontier to explore next is critical to both success and efficiency. Existing methods score frontiers from already-observed cues such as nearby objects or scene graphs, leaving the structure beyond each frontier implicit and offering no principled prior for choosing among rooms the agent has yet to see. In contrast, the hippocampal entorhinal system supports navigation through a predictive cognitive map that anticipates unseen space from partial observations. Inspired by this, we propose PredNav, which externalizes a hierarchical cognitive map with metric, instance-semantic, and topological layers, and casts frontier selection as room-level structured prediction over its topological layer. A language model infers the likely room type and target relevance behind each frontier, which is fused with CLIP visual evidence, an offline room category prior, and geodesic cost under phase-adaptive weights. A vision-language verifier then gates stop using direct visual evidence. Extensive experiments on MP3D and HM3D demonstrate the effectiveness of our method.
Anthology ID:
2026.emnlp-main.1079
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24795–24811
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1079/
DOI:
Bibkey:
Cite (ACL):
Qingao Chai, Jiashuo Wang, Rui Yan, and Huajin Tang. 2026. PredNav: A Predictive Cognitive Map for Zero-Shot Object Goal Navigation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 24795–24811, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
PredNav: A Predictive Cognitive Map for Zero-Shot Object Goal Navigation (Chai et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1079.pdf