Inference definition

The process of running a trained model to produce an answer, prediction, or generated file.

What it actually is under the hood

The model's fixed weights transform input tokens through many numerical operations. For language generation, this runs repeatedly, one token at a time.