Step 01 / 04
Not how you read
You read sentences as words and meaning. The model does not start there.
I absolutely love generative AI.
First the text is split into tokens: small chunks the model can process. Look at the chips on the right. It is often not one chip per word.
One sentence, many pieces
I absolutely love generative AI.
7 tokens
Those pieces (tokens) are what the network actually takes in.
One sentence, many pieces