AI Model Deployment & MLOps › Model Serving & APIs

How does Model Serving & APIs work

Beginner

Answer

The trained model is wrapped inside a service that accepts requests, runs the model on the input, and returns the prediction as a response, often in real time.
Real-world example A mobile app sends a photo to a model serving API and receives back a prediction of what object is in the photo.

Common follow-ups: What is AI Model Deployment & MLOps, How is Model Serving & APIs evaluated in practice, What tools are commonly used for Model Serving & APIs