GraP-Mem: Granularity-Aware Planning for Adaptive Memory Access in Long-Horizon LLM Agents

Qinyang Zeng, Jinhao Dong, Wei LU, Xiaoyong Du


Abstract
LLM agents increasingly operate in long-horizon tasks and extended dialogues, where they must retrieve useful past experiences beyond limited context windows. A central challenge is to balance efficient recall with faithful evidence recovery. Existing memory methods often rely on static access strategies: compact memories reduce context cost but may omit fine-grained evidence, whereas full histories preserve details but introduce redundant and noisy context. We propose GraP-Mem, a multi-granularity memory planning framework that adaptively schedules memory access for each question. GraP-Mem represents each historical session with two complementary views: compact semantic memories for efficient retrieval and source contexts for detailed evidence recovery. During inference, a Plan Agent generates retrieval-oriented information needs and queries, while an Integration Agent maintains a question-specific evidence state that consolidates useful evidence and identifies remaining gaps. When the evidence is incomplete, GraP-Mem selectively expands access to source contexts or performs additional retrieval. The final Answer Model is conditioned only on the integrated evidence state. Experiments on LoCoMo and NarrativeQA show that GraP-Mem consistently improves F1 and BLEU across backbone models, demonstrating the effectiveness of plan-guided memory access across multiple granularities.
Anthology ID:
2026.findings-emnlp.2375
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
51016–51032
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2375/
DOI:
Bibkey:
Cite (ACL):
Qinyang Zeng, Jinhao Dong, Wei LU, and Xiaoyong Du. 2026. GraP-Mem: Granularity-Aware Planning for Adaptive Memory Access in Long-Horizon LLM Agents. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 51016–51032, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GraP-Mem: Granularity-Aware Planning for Adaptive Memory Access in Long-Horizon LLM Agents (Zeng et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2375.pdf