How LLMs Think - Exercises
Test your understanding of language model internals with 7 progressive challenges.
Exercise 1: Token Counting (Warm-up)
Interactive exercise — requires JavaScript to display
Exercise 2: BPE Merge Steps
Interactive exercise — requires JavaScript to display
Exercise 3: Embedding Analogies
Interactive quiz — requires JavaScript to display
Exercise 4: Attention Score Calculator
Python
Interactive code editor — requires JavaScript
Exercise 5: Transformer Block Assembly
Interactive exercise — requires JavaScript to display
Exercise 6: Temperature Exploration
Python
Interactive code editor — requires JavaScript
Exercise 7: Chain-of-Thought Detection (Stretch)
Python
Interactive code editor — requires JavaScript