What is transformer?

A type of neural network that uses attention to connect parts of its input. It is used in many models that work with language, images, and other information.