Transformers & Language Models
Attention Weights
Click a word and see what it looks at. Real attention over real query and key projections — including the question a single head provably cannot answer.
Loading interactive lab…
Go deeper
The lessons behind the labs
The Open Library covers this material in full — free to read, no sign-up.
Browse the Open Library