"It learns over time" is the most common claim made about AI agents with memory, and the hardest one to show. You can't just say it. You have to run the same question at different points in the agent's life and put the answers side by side.
That's what I did with DejaVu, an incident-response agent that remembers past incidents and which fixes worked. Same alert, same model, same code; the only thing that changes is how much history is in memory. This article walks through the three answers and how the experiment is built.
Repo: https://github.com/cybersleuth25/Deja-Vu
The question
The alert is the same every time:
Checkout 500s: DB connection pool exhausted (payments-api)
It's a good test case because the "obvious" fix, restarting the connection pool, is the one that keeps failing for this team.…