Haojian Huang
Author directory2026
WorldLines: Benchmarking and Modeling Long-Horizon Stateful Embodied Agents
Yehang Zhang | Jianchong Su | Haojian Huang | Yifan Chang | Tianhao Zhou | Xinli Xu | Yingjie Xu | Yinchuan Li | Zexi Li | Ying-Cong Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yehang Zhang | Jianchong Su | Haojian Huang | Yifan Chang | Tianhao Zhou | Xinli Xu | Yingjie Xu | Yinchuan Li | Zexi Li | Ying-Cong Chen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
To assist humans over extended periods in real homes, embodied agents must remember user routines, world states, and past interactions. Existing long-term memory benchmarks mainly evaluate language-centric retrieval and question answering, while embodied benchmarks often focus on short-horizon task execution without testing long-term memory use in dynamic environments. We introduce WorldLines, a project-driven benchmark for long-horizon embodied household assistance. It constructs temporally extended household traces with dialogues, actions, execution feedback, object and device state changes, and converts them into evidence-linked samples for Memory QA and Embodied Task Planning. We further propose ObsMem, an observer-grounded memory framework that maintains visibility-aware memories and action-native state trails for state-aware decisions. Experiments reveal persistent challenges in partial observability, overwritten world states, and translating long-term memory into embodied plans, while ObsMem offers a stronger reference architecture for this setting.
2025
DependEval: Benchmarking LLMs for Repository Dependency Understanding
Junjia Du | Yadi Liu | Hongcheng Guo | Jiawei Wang | Haojian Huang | Yunyi Ni | Zhoujun Li
Findings of the Association for Computational Linguistics: ACL 2025
Junjia Du | Yadi Liu | Hongcheng Guo | Jiawei Wang | Haojian Huang | Yunyi Ni | Zhoujun Li
Findings of the Association for Computational Linguistics: ACL 2025
While large language models (LLMs) have shown considerable promise in code generation, real-world software development demands advanced repository-level reasoning. This includes understanding dependencies, project structures, and managing multi-file changes. However, the ability of LLMs to effectively comprehend and handle complex code repositories has yet to be fully explored. To address these challenges, we introduce a hierarchical benchmark designed to evaluate repository dependency understanding(DependEval) for LLMs. The benchmark is based on 2683 repositories collected from real-world websites. It evaluates models on three core tasks: Dependency Recognition, Repository Construction, and Multi-file Editing, across 8 programming languages from actual code repositories. Our evaluation of over 25 LLMs reveals substantial performance gaps and provides valuable insights into repository-level code understanding.