Deployment and MLOps · MLD-0555
Inference endpoint
An interface that accepts inputs and returns model predictions or generated outputs.
Original reference page · detailed expansion pending. Original definitions, examples, notes and citations are preserved below. New examples are illustrative, not benchmark results.
Original example
Call a hosted classification service.
Original caveat
Endpoint behavior includes preprocessing and configuration, not just weights.
Context and aliases
Level: Intermediate. Stages: Deployment · Monitoring.
Tags: ML · DL · LLM · SLM · MLOps.
Aliases: None recorded.
Related concepts
Original references
- Transformers glossary ↗ · Consulted
- Google Cloud MLOps architecture ↗ · Reference link
- scikit-learn User Guide ↗ · Consulted
- Original reference URL ↗