… the actor works with an agent or assistant across multiple sessions, and background facts, stated preferences, and recurring context would otherwise have to be repeated every time. Where remembered state restores how the actor arranged the interface, memory carries facts and preferences about the actor forward to shape what the system generates next. Where standing instructions hold rules the actor writes in their own words for every run, memory holds details the system extracts or records from ongoing conversations.
Problem
When a system carries facts and inferences about the actor from one session to the next without showing what it kept, continuity feels unpredictable: outdated details and one-off questions keep steering later answers, sensitive disclosures stick around indefinitely, and the actor has no direct way to inspect or fix what the system thinks it knows about them.
Details enter cross-session memory in two ways: the actor explicitly asks the system to remember something (“remember that I work in Python”), or the system extracts facts on its own from passing turns. Automatic extraction spares the actor from maintaining a profile by hand, which most people rarely do until an output goes wrong. However, background extraction also picks up temporary tasks, questions asked on someone else’s behalf, and sensitive details the actor never intended to make permanent.
Even when the system provides a list of saved memories, three tensions remain:
- Storage versus interpretation: actors expect saved memories to act like a static list of facts, yet a generative model reinterprets and combines them at run time, drawing unstated inferences or applying a preference from one task to an unrelated one.
- Incomplete removal across layers: deleting a fact from the memory list fails if the system re-extracts it from old transcripts in the activity log, or if the same behaviour survives in standing instructions.
- Defaults and upfront boundaries: because actors rarely audit a memory list after the fact, default collection rules and upfront exclusions do most of the real governing.
Solution
Make everything the system remembers about the actor inspectable, editable, and revocable as plain-language statements. Show inline transient feedback whenever a memory is saved or updated, link each entry to the conversation turn that produced it via provenance marking, and let the actor edit or delete entries individually or by topic. Scope memories to a workspace where projects or roles differ, let the actor set standing exclusions for topics the system must never retain, and ensure that deleting a memory stops it from being re-inferred from past history.
Keep system-extracted memory distinct from actor-written standing instructions and from conversation transcripts in the activity log. When the actor removes a memory, state clearly whether the underlying conversation turn remains in the transcript, and offer to remove both when the detail itself is sensitive.
Continuation
Stored facts and preferences are carried into later runs to tailor generated content without the actor restating their context. When the system saves a new detail during an exchange, transient feedback marks the update in place and provenance marking ties the entry back to the conversation turn it came from. A reviewable list in settings lets the actor read, edit, or remove what is kept, while rule composition lets them set standing exclusions over topics the system must never store. Scoping memory to a workspace keeps context for one project or role from bleeding into another, and an ephemeral session lets the actor step outside memory and history for a single exchange. Deletion removes individual facts or clears the store so they no longer steer future responses, separately from the activity log that records past transcripts…
All connections
- Precedes
- Generated content — Stored facts and preferences are carried into later runs to tailor generated content without the actor restating their context.
- Enacts
- Privacy — turns held-forward personal context into statements the actor can inspect, scope, and revoke
- Adaptability — tailors subsequent responses using an editable record of facts and preferences
- Complements
- Ephemeral session, workspace — Scoping memory to a workspace keeps context for one project or role from bleeding into another, and an ephemeral session lets the actor step outside memory and history for a single exchange.
- Standing instructions — Where standing instructions hold rules the actor writes in their own words for every run, memory holds details the system extracts or records from ongoing conversations.
- Transient feedback, provenance marking — When the system saves a new detail during an exchange, transient feedback marks the update in place and provenance marking ties the entry back to the conversation turn it came from.
- Settings, rule composition — A reviewable list in settings lets the actor read, edit, or remove what is kept, while rule composition lets them set standing exclusions over topics the system must never store.
- Deletion, activity log — Deletion removes individual facts or clears the store so they no longer steer future responses, separately from the activity log that records past transcripts
- Tangential to
- Remembered state — Where remembered state restores how the actor arranged the interface, memory carries facts and preferences about the actor forward to shape what the system generates next.
- Preceded by
- Session — The actor works with an agent or assistant across multiple sessions, and background facts, stated preferences, and recurring context would otherwise have to be repeated every time.
In practice
- Inline write receipts. When the system saves or updates a memory during an exchange, show a compact inline indicator (“Saved to memory”) that expands to reveal the exact statement stored, with an immediate action to undo or edit it in place rather than requiring a trip to settings.
- Editable memory list with provenance. Present stored memories as discrete, plain-language statements (or grouped topic cards) that the actor can read, reword, or delete. Attach provenance marking—the source session and date—so the actor can see where a belief came from and tell stated facts apart from system inferences.
- Workspace and project scope. Allow separate memory stores per workspace so client details, coding conventions, or role-specific context stay inside the project they belong to instead of bleeding into personal or unrelated sessions.
- Standing exclusions over what is never kept. Alongside post-hoc deletion, let the actor define upfront rules (through rule composition or topic toggles) for categories the system must never write to memory—such as health, finances, credentials, or third-party details—or route those exchanges to an ephemeral session.
Research on this pattern
- Kay (1995) and Kay and Kummerfeld (2012) established scrutable user models, showing that a personalisation profile should let the actor see what the system believes about them, where each item came from, and how to correct or remove it.
- Huang et al. (2023) (Memory Sandbox) and Yen and Zhao (2024) (Memolet) reified conversational memories as visible, interactive objects that actors can inspect, edit, toggle on or off, and reuse across sessions.
- Jones et al. (2025) found that people hold a storage-based mental model of AI memory—expecting an explicit filing cabinet of facts—while LLM memory operates through run-time interpretation and inference across contexts.
- Li, Wu, Li, Gui and Luo (2026) audited six conversational LLM platforms and showed that deletion controls act inconsistently across chat history, extracted memory items, and customisation layers, leaving actors uncertain about what “forget” actually removes.
- Malki et al. (2025) and Chen et al. (2026) documented how automatic cross-session memory over-applies sensitive disclosures to later tasks and exposes private context when multiple people share an account.
- Xu, Ding, Chang, Li and Bashir (2026) defined a 15-category taxonomy of the “negative space” of AI memory—information actors want excluded by default, including secrets, inferred traits, and temporary tasks—and demonstrated policy gates that block unwanted facts before storage.
Resources & references
- Kay, J. (1995). The um toolkit for cooperative user modelling, User Modeling and User-Adapted Interaction
- Huang, Z., Gutierrez, S., Kamana, H., & MacNeil, S. (2023). Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agents, UIST ‘23 Adjunct
- Yen, R., & Zhao, J. (2024). Memolet: Reifying the Reuse of User-AI Conversational Memories, UIST ‘24
- Jones, B. R., et al. (2025). From Storage to Interpretation: User Mental Models and Expectations of LLM Memory, CUI ‘25
- Malki, L., et al. (2025). “Wait, Did You Just Remember That?”: How LLM Memory Capabilities Shape User Privacy Mental Models and Behavior, PoPETs 2025
- Li, Z., Wu, Y., Li, Y., Gui, X., & Luo, Y. (2026). Privacy Control in Conversational LLM Platforms: A Walkthrough Study, CHI ‘26
- Chen, Y., et al. (2026). Sharing Account, Sharing Memories? Exploring Privacy and Security Strains in Multi-User LLM Sharing, CHI ‘26
- Xu, Z., Ding, Y., Chang, H., Li, Z., & Bashir, M. (2026). What Should AI Forget? A Design and Taxonomy for Negative Space Governance in AI Memory
- Shape of AI — Memory, Data ownership
- AI UX Playground — Memory Scope Toggle, Memory Management
- aiuxdesign.guide — Selective Memory
- AI Interface Layout Library — AI Memory Graph