Definition
The serving layer for approved models, including inference endpoints, routing, versions and capacity.
Why it matters
This concept requires clear ownership, integration and controls in a real implementation.
AI
Model Runtime
The serving layer for approved models, including inference endpoints, routing, versions and capacity.