Context window definition

The amount of text, code, or other input a model can consider in one request.

What it actually is under the hood

Inputs are converted to tokens and placed in the model's attention computation. A larger window raises compute and does not guarantee the model uses every detail equally well.

Read the related explainer: Context windows, without the marketing fog