Kaiyong Zhao
Author directory2026
Llm agent memory: a survey from a unified representation–management perspective
Zhenheng Tang | Xin He | Tiancheng Zhao | Fanjunduo Wei | Xiang Liu | Peijie Dong | Qian Wang | Qi Li | Huacan Wang | Ronghao Chen | Sen Hu | Weidong Guo | Yu Xu | Haolan Chen | Kunfeng Lai | Kaiyong Zhao | Keyan Ding | Ivor Tsang | Yew-Soon Ong | Bo Li | Xiaowen Chu
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhenheng Tang | Xin He | Tiancheng Zhao | Fanjunduo Wei | Xiang Liu | Peijie Dong | Qian Wang | Qi Li | Huacan Wang | Ronghao Chen | Sen Hu | Weidong Guo | Yu Xu | Haolan Chen | Kunfeng Lai | Kaiyong Zhao | Keyan Ding | Ivor Tsang | Yew-Soon Ong | Bo Li | Xiaowen Chu
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models (LLMs) face significant challenges in sustaining long-term memory for agentic applications due to limited context windows. To address this limitation, many work has proposed diverse memory mechanisms to support long-term, multi-turn interactions, leveraging different approaches tailored to distinct memory storage objects, such as KV caches. In this survey, we present a unified taxonomy that organizes memory systems for long-context scenarios by decoupling memory abstractions from model-specific inference and training methods. We categorize LLM memory into three primary paradigms: natural language tokens, intermediate representations and parameters. For each paradigm, we organize existing methods by three management stages, including memory construction, update, and query, so that long-context memory mechanisms can be described in a consistent way across system designs, with their implementation choices and constraints made explicit. Finally, we outline key research directions for long-context memory system design.
2025
UnrealLLM: Towards Highly Controllable and Interactable 3D Scene Generation by LLM-powered Procedural Content Generation
Song Tang | Kaiyong Zhao | Lei Wang | Yuliang Li | Xuebo Liu | Junyi Zou | Qiang Wang | Xiaowen Chu
Findings of the Association for Computational Linguistics: ACL 2025
Song Tang | Kaiyong Zhao | Lei Wang | Yuliang Li | Xuebo Liu | Junyi Zou | Qiang Wang | Xiaowen Chu
Findings of the Association for Computational Linguistics: ACL 2025
The creation of high-quality 3D scenes is essential for applications like video games and simulations, yet automating this process while retaining the benefits of Procedural Content Generation (PCG) remains challenging. In this paper, we introduce UnrealLLM, a novel multi-agent framework that connects natural language descriptions with the professional PCG system (Unreal Engine 5) to automate scene generation. UnrealLLM constructs a comprehensive knowledge base to translate text into executable PCG blueprints and a diverse asset library that guarantees high-quality scene generation. Additionally, it also introduces a text-based blueprint system with a spline-based control mechanism for geometric arrangement, enabling natural language interaction and enhancing interactivity in 3D environments using UE5’s advanced capabilities. Through extensive experiments, we show that UnrealLLM achieves competitive performance in technical metrics and aesthetic quality, offering unique advantages in generation scale and interactivity. This work makes a valuable contribution to automated 3D content creation, benefiting both novice users and professional designers.
Search