GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation

Arka Mukherjee, Soham Roy, Kartikeya Trivedi, Shreya Ghosh


Abstract
Modern Vision-Language Models (VLMs) perform well above the human baseline in image geolocalization, a task critically important in disaster response, OSINT verification, and location privacy. However, most efforts to study AI behavior on the task remain limited to static image-based retrieval, classification, and predictions. We argue that faithful recreation of the task should involve embodied navigation, where a multimodal agent autonomously explores its surroundings to gather observations before submitting a prediction. To this end, we introduce **GeoAgent**, an agentic environment-based benchmark that requires agents to navigate Street View environments to refine their geolocalization through sequential reasoning. Our analysis shows that modern VLMs struggle to discern regional patterns while succeeding at country- and continent-level predictions. When compared to static image-based baselines, agentic navigation significantly improves accuracy across established metrics. We also note severe bias in a developed/developing region context across frontier model architectures and poor self-improvement capabilities given incorrect priors. Overall, our work establishes the challenges of embodied navigation and geospatial reasoning. We publicly release our code and the GeoAgent environment: https://geoagent-benchmark.github.io
Anthology ID:
2026.findings-emnlp.1897
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40420–40450
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1897/
DOI:
Bibkey:
Cite (ACL):
Arka Mukherjee, Soham Roy, Kartikeya Trivedi, and Shreya Ghosh. 2026. GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 40420–40450, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GeoAgent: Evaluating VLM Geolocalization Through Embodied Navigation (Mukherjee et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1897.pdf