Aligning Agentic World Models via Knowledgeable Experience Learning

Baochang Ren, Yunzhi Yao, Rui Sun, Shuofei Qiao, Ningyu Zhang, Huajun Chen


Abstract
Current Large Language Models (LLMs) exhibit a critical modal disconnect: they possess vast semantic knowledge but lack the procedural grounding to respect immutable environmental constraints. Consequently, while these agents implicitly function as world models, their simulations often suffer from physical hallucinations—generating plans that are logically sound but physically unexecutable. Existing alignment strategies predominantly rely on resource-intensive training or fine-tuning, which attempt to compress dynamic environmental rules into static model parameters. However, such parametric encapsulation is inherently rigid, struggling to adapt to the open-ended variability of environmental dynamics without continuous, costly retraining. To solve this fundamental misalignment between semantic planning and environmental reality without relying on parameter updates, we introduce WorldMind, a framework that autonomously constructs a symbolic World Knowledge Repository by synthesizing environmental feedback. Specifically, it unifies Process Experience to enforce semantic physical feasibility via prediction errors and Goal Experience to guide task optimality through successful trajectories. Experiments on EB-ALFRED and EB-Habitat demonstrate that WorldMind achieves the best performance compared to baselines, exhibiting remarkable cross-model and cross-environment transferability.
Anthology ID:
2026.findings-emnlp.668
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
14024–14054
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.668/
DOI:
Bibkey:
Cite (ACL):
Baochang Ren, Yunzhi Yao, Rui Sun, Shuofei Qiao, Ningyu Zhang, and Huajun Chen. 2026. Aligning Agentic World Models via Knowledgeable Experience Learning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 14024–14054, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Aligning Agentic World Models via Knowledgeable Experience Learning (Ren et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.668.pdf