COMPILED CANVAS
GENERATIVE AI

ChatGPT never sees your words

It sees numbers. Here's how.

Tap to start →

STEP 1

Tokens

unbelievable

Text is cut into pieces. 100 tokens ≈ 75 English words.

1 of 4 · keep tapping →
STEP 2

Embeddings

✗ cat · dog: 0.99
✓ cat · car: −0.58

Each token becomes a list of numbers. Similar meanings sit close.

2 of 4 · keep tapping →
STEP 3

Scores

mat
floor
sofa
moon

The model scores every possible next token.

3 of 4 · keep tapping →
STEP 4

Pick & repeat

one token at a time

Pick one, add it to the text, and ask again.

4 of 4 · keep tapping →
⚠ MOST PEOPLE MISS THIS

The mistake

Thinking it looks answers up. It predicts the next token, one at a time.

QUICK QUIZ

Can you get it?

Tap an answer. The full video explains why.

📸 SCREENSHOT THIS

Cheat sheet

  • LLM predicts the next token
  • Token: a piece of a word
  • 100 tokens ≈ 75 words
  • Embedding: meaning as numbers
  • Softmax: scores → probabilities
COMPILED CANVAS

Want the full lesson?

▶ Watch the full videoPractice + free notes

Free Generative AI course. Subscribe to Compiled Canvas on YouTube.

Watch the full video