What is relevant?

Last lesson: Transformers let distant words influence each other. Attention is how that happens. For each piece of the sequence, the model asks: which other pieces help me right now?

Sarah gave Anna her laptop because she needed to leave.

Focus on “she.” Tap the words that help interpret it. People and the reason matter more than the object.