What is attention?

A way an AI model weighs which parts of its input matter to each other. It helps connect words across a sentence or a longer passage.

For example: In “the dog chased the ball because it bounced,” attention helps connect “it” with “ball.”