, a learner messaged me about a wrong answer.

She had asked the tutor about a concept from one of my Generative AI tutorials. The response looked fine. But it wasn’t. I had already rewritten that content two months earlier. My RAG system pulled a version from six months ago — not obviously wrong, just wrong enough to mislead.

She thought she had misunderstood. She hadn’t. My own system was teaching her from lessons I had already replaced.

I’m building a RAG-powered assistant for EmiTechLogic , my tech education platform — turning a content library into a system that generates answers directly from my own articles. I wrote about the initial architecture here . The initial architecture was manageable. The real challenge begins when real learners hit a live system.

When I pulled the retrieval logs, I saw exactly what happened. Both versions were in the vector store. The old one ranked first because it had more matching tokens and a higher cosine similarity score. The updated version came in second.…