Xinle Deng
Author directory2026
EM²Mem: Event-Centric Multimodal Memory for Large Language Models
Yijun Chen | Yaqi Zheng | Yanya Li | Boyi Xiao | Buqiang Xu | Shuofei Qiao | Jizhan Fang | Xinle Deng | Yunzhi Yao | Xuehai Wang | Liuxin Zhang | Hui Li | Huajun Chen | Shumin Deng
Findings of the Association for Computational Linguistics: EMNLP 2026
Yijun Chen | Yaqi Zheng | Yanya Li | Boyi Xiao | Buqiang Xu | Shuofei Qiao | Jizhan Fang | Xinle Deng | Yunzhi Yao | Xuehai Wang | Liuxin Zhang | Hui Li | Huajun Chen | Shumin Deng
Findings of the Association for Computational Linguistics: EMNLP 2026
Multimodal memory offers a scalable interface for long-video question answering, but existing methods often retrieve captions, frames, transcripts, summaries, or graph facts as isolated fragments. Although searchable, such fragments are not generation-ready: language models must reconstruct cross-modal and temporal alignments at inference time, when context is limited and attribution is difficult. We propose EM2Mem, an event-centric multimodal memory framework that binds heterogeneous evidence to event anchors during memory construction. Each event-indexed memory cell aligns multimodal records, temporal context, graph-linked relations, semantic facts, and provenance, enabling compact evidence readout over grounded multimodal events rather than modality-specific fragments. Across three long-video QA benchmarks, EM2Mem improves average accuracy over the strongest memory baseline by 2.0, 2.4, and 3.7 points, improves strict event-level Top-5 evidence recall by 7.0 points, and reduces per-query latency by 4.67× and total inference tokens by 63.66%.
TokenPilot: Cache-Efficient Context Management for LLM Agents
Buqiang Xu | Zirui Xue | Dianmou Chen | Chenyang Fu | Chiyu Wu | Caiying Huang | Chen Jiang | Jizhan Fang | Xinle Deng | Yijun Chen | Yunzhi Yao | Xuehai Wang | Jin Shang | Huajun Chen | Ningyu Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Buqiang Xu | Zirui Xue | Dianmou Chen | Chenyang Fu | Chiyu Wu | Caiying Huang | Chen Jiang | Jizhan Fang | Xinle Deng | Yijun Chen | Yunzhi Yao | Xuehai Wang | Jin Shang | Huajun Chen | Ningyu Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
As LLM agents are deployed in long-horizon sessions, context accumulation drives up inference costs. Existing approaches utilize text pruning or dynamic memory eviction to minimize token footprints; however, their unconstrained sequence mutations alter layouts, introducing prefix mismatches and cache invalidation. This reveals a critical trade-off between text sparsity and prompt cache continuity. To address this, we present **TokenPilot**, a dual-granularity context management framework. Globally, *Ingestion-Aware Compaction* acts as a framework harness to stabilize prompt prefixes and eliminate open-world environmental noise at the ingestion gate. Locally, *Lifecycle-Aware Eviction* monitors the ongoing residual utility of context segments, enforcing a conservative batch-turn schedule to offload content segments only when task relevance expires. Experiments on ‘PinchBench‘ and ‘Claw-Eval‘ under both isolated and continuous modes demonstrate that TokenPilot reduces costs by **61%** and **56%** in isolated mode, and **61%** and **87%** in continuous mode, while maintaining competitive performance compared to prior systems.
PAC: Progress-Augmented Advantage Curriculum for Multi-Task Reinforcement Learning of LLMs
Yuanqiang Yu | Yanzhao Zheng | Zhentao Zhang | Tianze Xu | Chao Ma | Jihuai Zhu | Jiashun Liu | Xinle Deng | Baohua Dong | Hangcheng Zhu | Ruohui Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuanqiang Yu | Yanzhao Zheng | Zhentao Zhang | Tianze Xu | Chao Ma | Jihuai Zhu | Jiashun Liu | Xinle Deng | Baohua Dong | Hangcheng Zhu | Ruohui Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Reinforcement learning (RL) is used to improve the reasoning abilities of LLMs, while training data span heterogeneous tasks. However, most RL post-training pipelines rely on fixed or manually designed task mixtures, even though task usefulness changes as training progresses. Online curriculum methods often define learnability by update magnitude, ignoring whether the update translates into reward gains, which can misallocate rollout budget toward tasks with large but ineffective updates. We propose PAC, a Progress-Augmented Advantage Curriculum for multi-task RL of LLMs that combines two task-level signals: advantage-derived learnability, which measures the magnitude of the policy update a task can induce, and recent reward gains, which show whether those updates have improved task performance. A Bayesian Thompson Sampling controller uses these signals to allocate rollouts across tasks during GRPO training. We evaluate PAC under two settings: a multi-level reasoning setting and a multi-domain reasoning setting. PAC improves sample efficiency and final performance: it reaches comparable validation scores with fewer rollout steps and achieves higher final averages than random sampling and advantage-based curriculum baselines in both settings. These results show that jointly tracking advantage signals and actual reward gains yields an effective online curriculum for LLM post-training.
Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency
Haoming Xu | Ningyuan Zhao | Yunzhi Yao | Weihong Xu | Hongru Wang | Xinle Deng | Shumin Deng | Jeff Z. Pan | Huajun Chen | Ningyu Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Haoming Xu | Ningyuan Zhao | Yunzhi Yao | Weihong Xu | Hongru Wang | Xinle Deng | Shumin Deng | Jeff Z. Pan | Huajun Chen | Ningyu Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
As Large Language Models (LLMs) are increasingly deployed in real-world settings, correctness alone is insufficient. Reliable deployment requires maintaining truthful beliefs under contextual perturbations. Existing evaluations largely rely on point-wise confidence like Self-Consistency, which can mask brittle belief. We show that even facts answered with perfect self-consistency can rapidly collapse under mild contextual interference. To address this gap, we propose Neighbor-Consistency Belief (NCB), a structural measure of belief robustness that evaluates response coherence across a conceptual neighborhood. To validate the efficiency of NCB, we introduce a new cognitive stress-testing protocol that probes outputs stability under contextual interference. Experiments across multiple LLMs show that the performance of high-NCB data is relatively more resistant to interference. Finally, we present Structure-Aware Training (SAT), which optimizes context-invariant belief structure and reduces long-tail knowledge brittleness by approximately 30%.
Temp-R1: A Unified Autonomous Agent for Complex Temporal KGQA via Reverse Curriculum Reinforcement Learning
Zhaoyan Gong | Zhiqiang Liu | Songze Li | Xiaoke Guo | Yuanxiang Liu | Xinle Deng | Zhizhen Liu | Lei Liang | Huajun Chen | Wen Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Zhaoyan Gong | Zhiqiang Liu | Songze Li | Xiaoke Guo | Yuanxiang Liu | Xinle Deng | Zhizhen Liu | Lei Liang | Huajun Chen | Wen Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Temporal Knowledge Graph Question Answering (TKGQA) is inherently challenging, as it requires sophisticated reasoning over dynamic facts with multi-hop dependencies and complex temporal constraints. Existing methods rely on fixed workflows and expensive closed-source APIs, limiting flexibility and scalability. We propose Temp-R1, the first autonomous end-to-end agent for TKGQA trained through reinforcement learning. To address cognitive overload in single-action reasoning, we expand the action space with specialized internal actions alongside external action. To prevent shortcut learning on simple questions, we introduce reverse curriculum learning that trains on difficult questions first, forcing the development of sophisticated reasoning before transferring to easier cases. Our 8B-parameter Temp-R1 achieves state-of-the-art performance on MultiTQ and TimelineKGQA, improving 19.8% over strong baselines on complex questions. Our work establishes a new paradigm for autonomous temporal reasoning agents. The code is available at https://github.com/zjukg/Temp-R1.
2025
EasyEdit2: An Easy-to-use Steering Framework for Editing Large Language Models
Ziwen Xu | Shuxun Wang | Kewei Xu | Haoming Xu | Mengru Wang | Xinle Deng | Yunzhi Yao | Guozhou Zheng | Huajun Chen | Ningyu Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Ziwen Xu | Shuxun Wang | Kewei Xu | Haoming Xu | Mengru Wang | Xinle Deng | Yunzhi Yao | Guozhou Zheng | Huajun Chen | Ningyu Zhang
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
In this paper, we introduce EasyEdit2, a framework designed to enable plug-and-play adjustability for controlling Large Language Model (LLM) behaviors. EasyEdit2 supports a wide range of test-time interventions, including safety, sentiment, personality, reasoning patterns, factuality, and language features. Unlike its predecessor, EasyEdit2 features a new architecture specifically designed for seamless model steering. It comprises key modules such as the steering vector generator and the steering vector applier, which enable automatic generation and application of steering vectors to influence the model’s behavior without modifying its parameters. One of the main advantages of EasyEdit2 is its ease of use—users do not need extensive technical knowledge. With just a single example, they can effectively guide and adjust the model’s responses, making precise control both accessible and efficient. Empirically, we report model steering performance across different LLMs, demonstrating the effectiveness of these techniques. We have released the source code on https://github.com/zjunlp/EasyEdit along with a demonstration notebook. In addition, we provide an online system at http://easyedit.zjukg.cn/for real-time model steering, and a demo video at https://www.youtube.com/watch?v=AkfoiPfp5rQ.
Search
Fix author
Co-authors
- Huajun Chen 5
- Yunzhi Yao 4
- Ningyu Zhang 3
- Yijun Chen 2
- Shumin Deng 2
- Jizhan Fang 2
- Xuehai Wang 2
- Buqiang Xu 2
- Haoming Xu 2
- Dianmou Chen 1
- Baohua Dong 1
- Chenyang Fu 1
- Zhaoyan Gong 1
- Xiaoke Guo 1
- Zhu Hangcheng 1
- Caiying Huang 1
- Ruohui Huang 1
- Chen Jiang 1
- Hui Li 1
- Songze Li 1
- Yanya Li 1
- Lei Liang 1
- Jiashun Liu 1
- Yuanxiang Liu 1
- Zhiqiang Liu (刘志强) 1
- Zhizhen Liu 1
- Chao Ma 1
- Jeff Z. Pan 1
- Shuofei Qiao 1
- Jin Shang 1
- Hongru Wang 1
- Mengru Wang 1
- Shuxun Wang 1
- Chiyu Wu 1
- Boyi Xiao 1
- Kewei Xu 1
- Tianze Xu 1
- Weihong Xu 1
- Ziwen Xu 1
- Zirui Xue 1
- Yuanqiang Yu 1
- Liuxin Zhang 1
- Wen Zhang 1
- Zhentao Zhang 1
- Ningyuan Zhao 1
- Guozhou Zheng 1
- Yanzhao Zheng 1
- Yaqi Zheng 1
- Jihuai Zhu 1