Step 01 / 04

Not how you read

You read sentences as words and meaning. The model does not start there.

I absolutely love generative AI.

First the text is split into tokens: small chunks the model can process. Look at the chips on the right. It is often not one chip per word.

One sentence, many pieces

I absolutely love generative AI.

7 tokens

Those pieces (tokens) are what the network actually takes in.

One sentence, many pieces