DDCG: Decoupled Dual-Critic Guidance for Embodied Agents

Shaojin Ma, Min Zhang, Hongyao Tang, Ruitao Wang, Jianye Hao, Yan Zheng


Abstract
Large Language Models (LLMs) have enabled embodied agents to perform high-level planning, yet grounding language-based plans into the physical world remains challenging. While feedback-based closed-loop planning is the dominant paradigm, existing methods typically rely on a single scalar feedback signal, which conflates physically infeasible actions that violate hard constraints with strategically sub-optimal but valid choices. We identify this structural limitation as Signal Confounding, which leads to ambiguous feedback and unreliable plan correction. To address this issue, we propose Decoupled Dual-Critic Guidance (DDCG), a framework that explicitly disentangles feedback into two complementary signals: a Feasibility Critic (CF) that enforces physical and logical executability constraints, and a Quality Critic (CQ) that evaluates the strategic value of feasible actions. This decoupled guidance enables precise error attribution during planning without requiring parameter updates to the LLM planner. We provide a theoretical interpretation of DDCG as critic-regularized planning with hard feasibility constraints. Experiments on two embodied planning benchmarks, VirtualHome and ScienceWorld, show that DDCG consistently improves plan executability and task success, particularly in long-horizon settings, highlighting the importance of structured feedback for reliable LLM-based planning.
Anthology ID:
2026.findings-emnlp.445
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9339–9360
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.445/
DOI:
Bibkey:
Cite (ACL):
Shaojin Ma, Min Zhang, Hongyao Tang, Ruitao Wang, Jianye Hao, and Yan Zheng. 2026. DDCG: Decoupled Dual-Critic Guidance for Embodied Agents. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 9339–9360, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DDCG: Decoupled Dual-Critic Guidance for Embodied Agents (Ma et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.445.pdf