free lessons
each lesson is one idea, in seven slides or a one-minute video. explained in my own words, from lectures, papers and other sources.
cs336 · unit 1 · lesson 01what is a token?
models don't read words. they read tokens. here's how text becomes ids and back.
▶ video 0:59
cs336 · unit 1 · lesson 02how tokens become numbers
every token gets a vector. the table that holds them learns too.
7-slide lesson
cs336 · unit 1 · lesson 03how tokens pay attention
each token looks back at the others to work out what a word means here.
7-slide lesson