Jingtao Qi
Author directory2026
LogicEnvGen: Task-Logic Driven Generation of Diverse Simulated Environments for Embodied AI
Jianan Wang | Siyang Zhang | Bin Li | Juan Chen | Jingtao Qi | Zhuo Zhang | Chen Qian
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jianan Wang | Siyang Zhang | Bin Li | Juan Chen | Jingtao Qi | Zhuo Zhang | Chen Qian
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Simulated environments play an essential role in embodied AI, functionally analogous to test cases in software engineering. However, existing environment generation methods often emphasize visual realism (e.g., object diversity and layout coherence), overlooking a crucial aspect: logical diversity from the testing perspective. This limits the comprehensive evaluation of embodied agent adaptability and planning robustness across distinct simulated environments. To bridge this gap, we propose LogicEnvGen, a novel method driven by Large Language Models (LLMs) that adopts a top-down paradigm to generate logically diverse simulated environments as test cases for agents. Given an agent task, LogicEnvGen first analyzes its execution logic to construct decision-tree-structured behavior plans and then synthesizes a set of logical trajectories. Subsequently, it adopts a heuristic algorithm to refine the trajectory set, reducing redundant simulation. For each logical trajectory, which represents a potential task situation, LogicEnvGen correspondingly instantiates a concrete simulated environment. Furthermore, we introduce LogicEnvEval, a novel benchmark for simulated environment generation, with four quantitative metrics. Experimental results verify the lack of logical diversity in baselines and demonstrate that LogicEnvGen achieves 1.08-2.67x greater diversity, significantly improving the performance in revealing agent faults by 3.34%–72.00%.
2025
BeSimulator: A Large Language Model Powered Text-based Behavior Simulator
Jianan Wang | Bin Li | Jingtao Qi | Xueying Wang | Fu Li | Lihanxun
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Jianan Wang | Bin Li | Jingtao Qi | Xueying Wang | Fu Li | Lihanxun
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Traditional robot simulators focus on physical process modeling and realistic rendering, often suffering from high computational costs, inefficiencies, and limited adaptability. To handle this issue, we concentrate on behavior simulation in robotics to analyze and validate the logic behind robot behaviors, aiming to achieve preliminary evaluation before deploying resource-intensive simulators and thus enhance simulation efficiency. In this paper, we propose BeSimulator, a modular and novel LLM-powered framework, as an attempt towards behavior simulation in the context of text-based environments. By constructing text-based virtual environments and performing semantic-level simulation, BeSimulator can generalize across scenarios and achieve long-horizon complex simulation. Inspired by human cognition paradigm, it employs a “consider-decide-capture-transfer” four-phase simulation process, termed Chain of Behavior Simulation (CBS), which excels at analyzing action feasibility and state transition. Additionally, BeSimulator incorporates code-driven reasoning to enable arithmetic operations and enhance reliability, and reflective feedback to refine simulation. Based on our manually constructed behavior-tree-based simulation benchmark, BTSIMBENCH, our experiments show a significant performance improvement in behavior simulation compared to baselines, ranging from 13.60% to 24.80%. Code and data are available at https://github.com/Dawn888888/BeSimulator.