Deniz Bilgin

Author directory

2026

Conversational agents are good at recall. But recall only reacts and an agent that answers only what it is asked can never raise what the user never thought to mention. We study the other direction which we call prospective memory. A background agent keeps a small set of pins in the assistant’s context before any question arrives and each pin must be retired by the right authority. A constraint from chat, such as a stolen bike, ends only on the user’s word. One from a city feed, such as a suspended tram line, ends only on the feed’s end message, whatever its forecast said. We release a benchmark of 60 days, ten users and 1,802 graded decisions in a mobility assistant, with automatic answer keys for pinning, forgetting, recommendation and habit discovery. Capture, at least of the templated reveals this benchmark renders, is the easy half. A dense 8B model captures events almost as well as a 397B/17B sparse one and what separates the two is forgetting. The small model hoards and invents. The large model’s one systematic failure is a release cascade, asked to rewrite its whole pin table, it treats any release signal as a reason to shorten it. Asked instead to name its removals as explicit operations, it names only the right ones, every swept pin survives, and required session recall rises from 0.77 to 0.99, from 0.80 to 1.00 on the events both runs captured.
Long-term conversational AI requires two distinct capabilities: remembering what was discussed and adapting to how a user’s preferences evolve over time. We argue these operate on different timescales and require separate but interoperable architectures. AgenticLOCI is a five-agent framework built on this premise: session retrieval fuses a short-term semantic ranker with a long-term keyword scorer via rank fusion, while personalization is maintained through a versioned deliberation-state memory that accumulates decision-episode snapshots across interactions. We evaluate on three benchmarks using Qwen 2.5-7B-Instruct. On LoCoMo, the AgenticLOCI Backbone achieves F1 = 0.342 versus BM25 = 0.285 while consuming 7.3× fewer input tokens per item. On LongMemEval-S, item-level analysis confirms that the two retrieval layers solve architecturally distinct sub-problems; at 7B scale the keyword layer leads, a reversal expected to resolve at larger model sizes where LLM ranking is more reliable. On PersonaMem, all configurations perform within a narrow band, establishing that memory benefit is conditional on context-budget pressure. The longitudinal personalization layer is evaluated on a synthetic mobility benchmark with known user trajectories, keeping 97.6% of stable preference fields unchanged and making warranted updates with 58.3% precision against an ablation baseline. We demonstrate the full framework as a personalized urban mobility assistant for Magdeburg.