Menu

1 / 3

Your AI remembers the old answer. How do you handle facts that changed?

DEV Community: database·woochan·about 23 hours ago
#7P89zFp8
#devtodatabase#devto#dev#memory#true
Reading 0:00
15s threshold

I work at Wontopos, so I'm biased. I build a memory API. But this post isn't about it. It's about a problem I keep reading about, and I want to hear how you deal with it.

The problem

An AI that remembers things will sooner or later remember something that is no longer true.

Here is a made-up example, just to show the shape of it:

When What the user says What gets stored

March "I live in Seoul." lives in Seoul

July "I moved to Busan last month." lives in Busan

October "Find me a good dentist nearby." ???

Both memories are true statements. One of them stopped being true. If the memory layer only looks for text that is similar to the question, both come back, and the model has to guess which one wins. Sometimes it guesses wrong, and it sounds confident when it does.

That's the part that bothers me. A missing memory is easy to notice. An old memory that sounds right is not.

Why it's harder than it looks

Similar is not the same as current. Search finds what matches the question.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.