Skip to main contentInference explained — Running a trained model to produce output
Inference is the process of applying a trained model to new input and computing a result.
An everyday example
A model receives your translation request and generates an English version of the supplied text.
When you’ll encounter it
Inference services, speed and hardware requirements concern the operation and cost of running models.
What to watch for
Inference is broader than step-by-step reasoning. Even a simple greeting involves inference; it does not mean the model is being retrained.
Related terms & sources
Prepared from the public sources below. Examples illustrate the concept. Reviewed on 2026-10-15.