Sep 23, 2026
A transformer you can poke
I keep sending people to "Attention is All You Need" and then watching the useful bits bounce right off. Fair. Dense paper, static diagrams, not much to grab onto.
Then I landed on Transformer Explainer. It's a real GPT-2 small running in the browser, with the whole stack laid out so you can type a prompt, drag temperature, and watch attention light up between tokens. Embedding, multi-head attention, MLP, next-token probs. Same architecture as the big models, just small enough to poke.
What stuck: for anyone curious how transformers actually work, this is way more useful than another abstract write-up. You learn by playing with it.
