Perceive to Hypothesize, Verify to Ground: an Agentic Reasoning Framework for Open-World Geo-Localization

Yutian Jiang, Ruijie Li, Sisuo Lyu, Xixuan Hao, Qingxiang Liu, Yongzi Yu, Yuxuan Liang


Abstract
Open-world geo-localization requires models to reason over ambiguous visual cues through multi-step reasoning and external knowledge grounding. While recent large vision-language models exhibit strong multimodal reasoning capabilities, existing approaches still suffer from perceptual hallucination and context drift due to the lack of explicit evidence-grounded verification. In this work, we reformulate geo-localization as a human-like perceive-then-verify reasoning problem and propose GeoPAVE (Geo-localization Perception-and-Verification-Engine), a bi-level agentic framework that contains perception-based hypothesis generation via single-pass rollouts and verification-based evidence grounding for decision actions: support, refute, and refine. To support rigorous evaluation, we further introduce PAVED, a novel dataset derived from real-world user check-in data, equipped with comprehensive reasoning trajectories featuring multi-hop queries, multi-round tool invocations, and structured perception-verification traces. The dataset and code are available at https://github.com/Arandinglv/GeoPAVE.
Anthology ID:
2026.emnlp-main.1984
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
45132–45153
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1984/
DOI:
Bibkey:
Cite (ACL):
Yutian Jiang, Ruijie Li, Sisuo Lyu, Xixuan Hao, Qingxiang Liu, Yongzi Yu, and Yuxuan Liang. 2026. Perceive to Hypothesize, Verify to Ground: an Agentic Reasoning Framework for Open-World Geo-Localization. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 45132–45153, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Perceive to Hypothesize, Verify to Ground: an Agentic Reasoning Framework for Open-World Geo-Localization (Jiang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1984.pdf