Transformers & Language Models
Tokenization
A real byte-pair tokenizer, trained live on a small corpus. Type “strawberry” and see why a model that writes essays cannot count the r’s in it.
Loading interactive lab…
Go deeper
The lessons behind the labs
The Open Library covers this material in full — free to read, no sign-up.
Browse the Open Library