AI Glossary
Inference
What is Inference?
The process of running a trained model to generate outputs. When you send a prompt to ChatGPT and receive a response, the model is performing inference.
Example in practice
Every time a customer service agent sends a support query to their AI assistant and receives a response, the model is performing inference — applying learned patterns to generate a new output.
See also