Memory–Environment Dual-Grounding for Embodied Agents: Active Information Seeking Beyond Passive Observation

Jae-Woo Choi, Sehoon Oh, Ue-Hwan Kim


Abstract
Recent LLM-based embodied agents have advanced in high-level task planning. Yet, they frequently suffer from hallucinations and brittle reasoning due to passive observation—either omitting fine-grained attributes or overwhelming the planner with irrelevant information. We propose SceneQueryPlanner, a memory-environment dual-grounded agent that integrates active information seeking into the planning loop by decomposing instructions and selectively executing environmental interactions or structured queries over a dynamic 3D scene graph to retrieve task-relevant information on demand. By treating information acquisition as a first-class planning action, our approach enables explicit verification and supports reliable long-horizon reasoning over object attributes. For rigorous evaluation, we introduce AttPlan-Bench, a benchmark of multi-room, long-horizon household tasks requiring attribute-aware reasoning. Experiments demonstrate that our dual-grounding strategy outperforms passive baselines, yielding more stable and scalable reasoning across diverse tasks.
Anthology ID:
2026.findings-emnlp.16
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
317–338
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.16/
DOI:
Bibkey:
Cite (ACL):
Jae-Woo Choi, Sehoon Oh, and Ue-Hwan Kim. 2026. Memory–Environment Dual-Grounding for Embodied Agents: Active Information Seeking Beyond Passive Observation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 317–338, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Memory–Environment Dual-Grounding for Embodied Agents: Active Information Seeking Beyond Passive Observation (Choi et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.16.pdf