Ryen W White
Author directory2026
Thinking Ahead: Prospection-Guided Retrieval of Memory with Language Models
Harshita Chopra | Krishna Kant Chintalapudi | Suman Nath | Ryen W White | Chirag Shah
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Harshita Chopra | Krishna Kant Chintalapudi | Suman Nath | Ryen W White | Chirag Shah
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-horizon personalization requires dialog assistants to retrieve user-specific facts from extended interaction histories. However, many relevant facts have low semantic similarity to the query under dense retrieval. Standard Retrieval-Augmented Generation (RAG) and GraphRAG systems remain largely retrospective: they rely on embedding similarity or fixed graph traversals, often missing relevant facts that lie far from the query in embedding space. Inspired by prospection, the human ability to use imagined futures as cues for recall, we introduce Prospection-Guided Retrieval (PGR), which decouples retrieval from memory storage. Given a user query, PGR expands the goal into a linear chain or tree of thoughts (TOT) denoting plausible next steps, and uses these steps as retrieval probes instead of the original query alone. Retrieved facts are then used to personalize the next round of prospection, enabling PGR to uncover additional memories by grounding the simulation in the user’s history. We also introduce MemoryQuest, a challenging multi-session benchmark where each query is annotated with 3–5 dated reference facts under a low query-reference similarity constraint. Across 1,625 queries spanning 185 user profiles from 3 public datasets, PGR-TOT substantially improves retrieval, achieving nearly 3x recall on MemoryQuest over baselines. In pairwise LLM-as-judge evaluations, PGR-generated responses are preferred on 89–98% of queries, with blinded human annotations showing a similar trend. Overall, the results show that explicit prospection yields large gains in long-horizon retrieval and response quality over similarity-only baselines.