A few weeks ago I wrote about LLM Explained , a free, open-source course of 43 interactive pages that takes you from tokens to AI agents. Each page has a scroll-driven animation, an Intuition / Mechanics / Maths depth switch, runnable Python and a short quiz.
The most common question I got afterwards was some version of:
"OK, I understand attention. But what is actually different between Llama, DeepSeek, Qwen and Gemma?"
So I built the answer into the site: an Architecture Atlas .
👉 Live: https://llm-explained-lovat.vercel.app/#arch
⭐ Repo: https://github.com/amananandrai/llm-explained
The one idea behind the atlas
Every large language model you can download today is the same machine : a stack of identical blocks, each with an attention layer and a feed-forward layer, joined by a residual stream.
The models differ in a short list of part choices :
Which normalisation (LayerNorm, RMSNorm, pre- or post-norm)?
How is position encoded (sinusoids, learned, RoPE, none)?
How many key/value heads (MHA,…