Step 01 / 04

Three roles in a search

Map

Last lesson: attention means “which other pieces help me right now?” Inside the model, that search is often described with three roles.

Picture a library:

  • Query: what you are looking for
  • Key: the spine label on each book, used for matching
  • Value: the useful pages inside a matched book

You match your query to keys. Stronger matches get more weight. Then you blend the values from those matches. Watch the roles cycle on the right.

Query → Keys → Values → output

Query

Looking for

Key

Match label

Value

Payload

Now

Query

What am I looking for?

You do not need the matrix math. Know the roles and the flow.

Query → Keys → Values → output