What does "it" refer to?

Language is full of long-range relationships. Try this sentence:

The animal didn't cross the road because it was tired.

You resolve “it” without thinking hard. Models need a mechanism that can relate distant positions in a sequence. That is one of the problems Transformers handle especially well.