Step 01 / 04

You still have to pick

Map

Last lesson: softmax gives a probability pie. Sampling is how you choose a slice.

  • Always take the biggest slice (greedy): simple, often repetitive
  • Or roll the dice using the pie (sampling): more variety, more risk

Temperature is the main dial builders feel first. It reshapes the pie before you roll.

Greedy

Look at the pie
↓
Always take the top slice

Sample

Look at the pie
↓
Roll using those chances

Same pie. Different picking rule.

Two ways to choose