Chuanrui Hu
Author directory2026
EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
Xingze Gao | Chuanrui Hu | Hongda Chen | Pengfei Yao | Zhao Wang | Yi Bai | Zhengwei Wu | Yunyun Han | Xiaofeng Cong | Jie Gui | Yafeng Deng | Teng Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Xingze Gao | Chuanrui Hu | Hongda Chen | Pengfei Yao | Zhao Wang | Yi Bai | Zhengwei Wu | Yunyun Han | Xiaofeng Cong | Jie Gui | Yafeng Deng | Teng Li
Findings of the Association for Computational Linguistics: EMNLP 2026
Agent self-evolution in long-horizon LLM systems is largely procedural: useful experience is not merely stored information, but reusable procedures for searching, debugging, and verification. Yet current evaluations do not isolate this form of transfer. Agent benchmarks test single-episode task solving; memory benchmarks target information retention rather than procedural reuse. We introduce EvoAgentBench, a benchmark for agent self-evolution with Ability-guided transfer evaluated separately in four agentic domains: web research, algorithmic reasoning, software engineering, and knowledge work. EvoAgentBench extracts trace-grounded Abilities from agent executions, canonicalizes them into operational units, and builds domain-specific Ability Graphs linking tasks that share procedural overlap. By design, every test task is backed by verified training-side Ability support. Across a 528/267 train/test split, two scaffolds, and three backbones, curated Ability content yields a positive aggregate effect and positive gains in every evaluated configuration, while gains from current automatic methods remain inconsistent across configurations. EvoAgentBench shifts self-evolution evaluation from aggregate accuracy comparison to fine-grained diagnosis of experience encoding, routing, exposure, and uptake.
EverMemOS: A Self-Organizing Memory Operating System for Structured Long-Horizon Reasoning
Chuanrui Hu | Xingze Gao | Zuyi Zhou | Dannong Xu | Yi Bai | Xintong Li | Hui Zhang | Tong Li | Chong Zhang | Lidong Bing | Yafeng Deng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Chuanrui Hu | Xingze Gao | Zuyi Zhou | Dannong Xu | Yi Bai | Xintong Li | Hui Zhang | Tong Li | Chong Zhang | Lidong Bing | Yafeng Deng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Models (LLMs) are increasingly deployed as long-term interactive agents, yet their limited context windows make it difficult to sustain coherent behavior over extended interactions. Existing memory systems for LLMs often store isolated records and retrieve fragments, limiting their ability to consolidate evolving experience and resolve conflicts. We introduce EverMemOS, a self-organizing memory operating system that implements an engram-inspired lifecycle for computational memory. First, Episodic Trace Formation converts dialogue streams into MemCells that capture episodic traces, atomic facts, and time-bounded foresight. Second, Semantic Consolidation organizes MemCells into thematic MemScenes, distilling stable semantic structures and updating user profiles. Finally, Reconstructive Recollection performs MemScene-guided agentic retrieval to compose the necessary and sufficient context for downstream reasoning. Experiments on LoCoMo, LongMemEval, and PersonaMem-v2 show that EverMemOS significantly outperforms state-of-the-art methods on memory-augmented reasoning tasks.
HyperMem: Hypergraph Memory for Long-Term Conversations
Juwei Yue | Chuanrui Hu | Jiawei Sheng | Zuyi Zhou | Wenyuan Zhang | Tingwen Liu | Li Guo | Yafeng Deng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Juwei Yue | Chuanrui Hu | Jiawei Sheng | Zuyi Zhou | Wenyuan Zhang | Tingwen Liu | Li Guo | Yafeng Deng
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Long-term memory is essential for conversational agents to maintain coherence, track persistent tasks, and provide personalized interactions across extended dialogues. However, existing approaches as Retrieval-Augmented Generation (RAG) and graph-based memory mostly rely on pairwise relations, which can hardly capture high-order associations, i.e., joint dependencies among multiple elements, causing fragmented retrieval. To this end, we propose HyperMem, a hypergraph-based hierarchical memory architecture that explicitly models such associations using hyperedges. Particularly, HyperMem structures memory into three levels: topics, episodes, and facts, and groups related episodes and their facts via hyperedges, unifying scattered content into coherent units. Leveraging this structure, we design a hybrid lexical-semantic index and a coarse-to-fine retrieval strategy, supporting accurate and efficient retrieval of high-order associations. Experiments on the LoCoMo benchmark show that HyperMem achieves state-of-the-art performance with 92.73% LLM-as-a-judge accuracy, demonstrating the effectiveness of HyperMem for long-term conversations.
2025
Exploring Multimodal Challenges in Toxic Chinese Detection: Taxonomy, Benchmark, and Findings
Shujian Yang | Shiyao Cui | Chuanrui Hu | Haicheng Wang | Tianwei Zhang | Minlie Huang | Jialiang Lu | Han Qiu
Findings of the Association for Computational Linguistics: ACL 2025
Shujian Yang | Shiyao Cui | Chuanrui Hu | Haicheng Wang | Tianwei Zhang | Minlie Huang | Jialiang Lu | Han Qiu
Findings of the Association for Computational Linguistics: ACL 2025
Detecting toxic content using language models is important but challenging. While large language models (LLMs) have demonstrated strong performance in understanding Chinese, recent studies show that simple character substitutions in toxic Chinese text can easily confuse the state-of-the-art (SOTA) LLMs. In this paper, we highlight the multimodal nature of Chinese language as a key challenge for deploying LLMs in toxic Chinese detection. First, we propose a taxonomy of 3 perturbation strategies and 8 specific approaches in toxic Chinese content. Then, we curate a dataset based on this taxonomy, and benchmark 9 SOTA LLMs (from both the US and China) to assess if they can detect perturbed toxic Chinese text. Additionally, we explore cost-effective enhancement solutions like in-context learning (ICL) and supervised fine-tuning (SFT). Our results reveal two important findings. (1) LLMs are less capable of detecting perturbed multimodal Chinese toxic contents. (2) ICL or SFT with a small number of perturbed examples may cause the LLMs “overcorrect”: misidentify many normal Chinese contents as toxic.
Search
Fix author
Co-authors
- Yafeng Deng 3
- Yi Bai 2
- Xingze Gao 2
- Zuyi Zhou 2
- Lidong Bing 1
- Hongda Chen 1
- Xiaofeng Cong 1
- Shiyao Cui 1
- Jie Gui 1
- Li Guo 1
- Yunyun Han 1
- Minlie Huang 1
- Teng Li 1
- Tong Li 1
- Xintong Li 1
- Tingwen Liu 1
- Jialiang Lu 1
- Han Qiu 1
- Jiawei Sheng 1
- Haicheng Wang 1
- Zhao Wang 1
- Zhengwei Wu 1
- Dannong Xu 1
- Shujian Yang 1
- Pengfei Yao 1
- Juwei Yue 1
- Chong Zhang 1
- Hui Zhang 1
- Tianwei Zhang 1
- Wenyuan Zhang 1