Transformer definition

The neural-network architecture behind most modern large language models.

What it actually is under the hood

Its attention layers let each token weigh the relevance of other tokens in the input. Stacked layers build increasingly abstract representations before predicting output.

Read the related explainer: A practical guide to transformers