If you use ChatGPT, Claude, Grok, Copilot, or Gemini daily, it feels like you're talking to a person. It remembers what you said three messages ago. It references the project details you shared yesterday. It feels like the model has a persistent brain that is learning about you.

But it’s a lie.

From an architectural standpoint, an LLM is the most "forgetful" piece of software you will ever use. Every time you hit "Send," the model starts at a blank slate.

So, how does it maintain your chat history? The answer lies in the Context Window and the engineering that happens outside the model’s weights.

The Reality: LLMs Are Stateless

Large Language Models (Transformers) are stateless functions. In computer science terms, a stateless service processes a request based solely on the input provided at that moment.

When you send a prompt:

The model receives your current message.

It generates a response.

It then discards everything.…