Inference

Inference is running a trained model on an input to produce a prediction, generation, score, or other output.

Plan for this page

Understand one concept in plain language and connect it to nearby ideas.

You will leave with: The model applies its current learned parameters rather than repeating the full training process. Product systems may add preprocessing, retrieval, tools, sampling, filters, or human review around that model run.
Time: 3–8 min
Before you begin: No prerequisite. Keep one real example in mind.
Do this now: Read the explanation, then compare the example with the common misunderstanding.

Prepared next stepSee the model-use stage

InferenceInference is running a trained model on an input to produce a prediction, generation, score, or other output.

Model
Training
Prediction

Plain explanation

The model applies its current learned parameters rather than repeating the full training process. Product systems may add preprocessing, retrieval, tools, sampling, filters, or human review around that model run.

Example

When a speech recognizer converts a new audio clip into text, it is performing inference with a trained model.

Why it matters

Inference is where users encounter model behavior and where latency, cost, permissions, context, and output checks become operational concerns. It should not be confused with proof that the output is true.

Common misunderstanding

Misconception: inference means the model logically proved its answer. Correction: in machine learning, it usually means producing an output from learned parameters.

Related concepts

Follow relationships, not only the alphabet

ModelA model is a learned or designed representation that maps inputs to outputs for a defined task or family of tasks.TrainingTraining is the process of adjusting a model to improve performance on an objective using data, feedback, or interaction.PredictionA prediction is a model’s estimated output for a given input, including a class, value, probability, sequence, or next element.

See the model-use stage

Sources and scope

What supports this object

Machine Learning GlossaryGoogle for Developers

Defines machine-learning inference; the word has other meanings in statistics and ordinary reasoning.

Open source

Loading page content...

…