Jie Zou
Author directory2026
From Topical Relevance to Answerability: Entailment Distillation for Conversational Retrieval
Shuai Qin | Guojia An | Weikang Guo | Pei Ke | Jiwei Wei | Yang Yang | Jie Zou
Findings of the Association for Computational Linguistics: EMNLP 2026
Shuai Qin | Guojia An | Weikang Guo | Pei Ke | Jiwei Wei | Yang Yang | Jie Zou
Findings of the Association for Computational Linguistics: EMNLP 2026
Existing conversational retrievers commonly treat topical relevance as a proxy for answerability. However, a passage that closely matches the dialogue context is not necessarily the one that supports the correct answer. We identify this mismatch as a systematic answerability gap. To address this issue, we propose CLEAR, a framework that shifts conversational retrieval from topical relevance to answerability. The core of CLEAR is entailment distillation, which transfers answer-passage entailment supervision into a cross-encoder reranker so that the reranker discriminates answer-supporting passages from topical distractors at inference time, without requiring answers. CLEAR is complemented by a passage-centric abductive recall module that brings low-similarity yet answerable passages into the candidate pool by inferring answerable queries from passages with an LLM. Across TopiOCQA, QReCC, and out-of-domain TREC CAsT datasets, CLEAR consistently improves top-ranked precision over strong query-rewriting and dense-retrieval baselines, with the largest gains observed in conversations involving heavier topical noise. Moreover, applying our reranker on top of an LLM-driven query rewriter yields further gains.
Lightweight LLM Agent Memory with Small Language Models
Jiaquan Zhang | Chaoning Zhang | Shuxu Chen | Zhenzhen Huang | Pengcheng Zheng | Zhicheng Wang | Ping Guo | Fan Mo | Sung-Ho Bae | Jie Zou | Jiwei Wei | Yang Yang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Jiaquan Zhang | Chaoning Zhang | Shuxu Chen | Zhenzhen Huang | Pengcheng Zheng | Zhicheng Wang | Ping Guo | Fan Mo | Sung-Ho Bae | Jie Zou | Jiwei Wei | Yang Yang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Although LLM agents can leverage tools for complex tasks, they still need memory to maintain cross-turn consistency and accumulate reusable information in long-horizon interactions. However, retrieval-based external memory systems incur low online overhead but suffer from unstable accuracy due to limited query construction and candidate filtering. In contrast, many systems use repeated large-model calls for online memory operations, improving accuracy but accumulating latency over long interactions. We propose LightMem, a lightweight memory system for better agent memory driven by Small Language Models (SLMs). LightMem modularizes memory retrieval, writing, and long-term consolidation, and separates online processing from offline consolidation to enable efficient memory invocation under bounded compute. We organize memory into short-term memory (STM) for immediate conversational context, mid-term memory (MTM) for reusable interaction summaries, and long-term memory (LTM) for consolidated knowledge, and uses user identifiers to support independent retrieval and incremental maintenance in multi-user settings. Online, LightMem operates under a fixed retrieval budget and selects memories via a two-stage procedure: vector-based coarse retrieval followed by semantic consistency re-ranking. Offline, it abstracts reusable interaction evidence and incrementally integrates it into LTM. Experiments show consistent gains across model scales, with an average F1 improvement of about 2.5 over A-MEM on LoCoMo, while achieving higher efficiency and low median latency (83 ms for retrieval and 581 ms end-to-end).