Deconstructing Spatial Complexity: Hierarchical Decomposition for LLM Spatial Reasoning

Yi Wang, Haojie Lu, Chen Li, Sihong Xie


Abstract
LLMs have shown remarkable proficiency in general language understanding and reasoning. However, they consistently underperform in spatial reasoning that severely limits their application, particularly in embodied intelligence. Inspired by the success of hierarchical reinforcement learning, this paper introduces a novel method for hierarchical task decomposition in LLM spatial reasoning. Our approach guides LLMs to decompose complex tasks into manageable sub-tasks by identifying key intermediate states and generating simplified sub-environments. However, we identify that LLMs often fail to derive optimal intermediate states due to their insufficient spatial prior, leading to sub-optimal task decomposition. To address this limitation and enhance its planning capability, we propose a MCTS-Guided Group Relative Policy Optimization (M-GRPO). where we reformulate the UCT formula by incorporating the LLM’s prior predictive probabilities alongside its epistemic uncertainty. Furthermore, we implement a more fine-grained advantage function, enabling the model to learn optimal path planning. Experimental results demonstrate that our method substantially improves LLM performance on spatial tasks, including navigation, planning, and strategic games, achieving state-of-the-art results. This work paves the way for LLMs in real-world applications.
Anthology ID:
2026.emnlp-main.2610
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
59298–59319
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2610/
DOI:
Bibkey:
Cite (ACL):
Yi Wang, Haojie Lu, Chen Li, and Sihong Xie. 2026. Deconstructing Spatial Complexity: Hierarchical Decomposition for LLM Spatial Reasoning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 59298–59319, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Deconstructing Spatial Complexity: Hierarchical Decomposition for LLM Spatial Reasoning (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2610.pdf