Thinking Ahead: Prospection-Guided Retrieval of Memory with Language Models

Harshita Chopra, Krishna Kant Chintalapudi, Suman Nath, Ryen W White, Chirag Shah


Abstract
Long-horizon personalization requires dialog assistants to retrieve user-specific facts from extended interaction histories. However, many relevant facts have low semantic similarity to the query under dense retrieval. Standard Retrieval-Augmented Generation (RAG) and GraphRAG systems remain largely retrospective: they rely on embedding similarity or fixed graph traversals, often missing relevant facts that lie far from the query in embedding space. Inspired by prospection, the human ability to use imagined futures as cues for recall, we introduce Prospection-Guided Retrieval (PGR), which decouples retrieval from memory storage. Given a user query, PGR expands the goal into a linear chain or tree of thoughts (TOT) denoting plausible next steps, and uses these steps as retrieval probes instead of the original query alone. Retrieved facts are then used to personalize the next round of prospection, enabling PGR to uncover additional memories by grounding the simulation in the user’s history. We also introduce MemoryQuest, a challenging multi-session benchmark where each query is annotated with 3–5 dated reference facts under a low query-reference similarity constraint. Across 1,625 queries spanning 185 user profiles from 3 public datasets, PGR-TOT substantially improves retrieval, achieving nearly 3x recall on MemoryQuest over baselines. In pairwise LLM-as-judge evaluations, PGR-generated responses are preferred on 89–98% of queries, with blinded human annotations showing a similar trend. Overall, the results show that explicit prospection yields large gains in long-horizon retrieval and response quality over similarity-only baselines.
Anthology ID:
2026.emnlp-main.2054
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
46773–46794
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2054/
DOI:
Bibkey:
Cite (ACL):
Harshita Chopra, Krishna Kant Chintalapudi, Suman Nath, Ryen W White, and Chirag Shah. 2026. Thinking Ahead: Prospection-Guided Retrieval of Memory with Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 46773–46794, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Thinking Ahead: Prospection-Guided Retrieval of Memory with Language Models (Chopra et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2054.pdf