I work at Wontopos, so I'm biased. I build a memory API. But this post isn't about it. It's about a problem I keep reading about, and I want to hear how you deal with it.
The problem
An AI that remembers things will sooner or later remember something that is no longer true.
Here is a made-up example, just to show the shape of it:
When What the user says What gets stored
March "I live in Seoul." lives in Seoul
July "I moved to Busan last month." lives in Busan
October "Find me a good dentist nearby." ???
Both memories are true statements. One of them stopped being true. If the memory layer only looks for text that is similar to the question, both come back, and the model has to guess which one wins. Sometimes it guesses wrong, and it sounds confident when it does.
That's the part that bothers me. A missing memory is easy to notice. An old memory that sounds right is not.
Why it's harder than it looks
Similar is not the same as current. Search finds what matches the question.…