Short answer
An AI Gateway sits between applications and model services to manage authentication, policy, routing, logging, quotas and model changes without binding applications to a single endpoint.
Why this matters
This design choice directly affects correctness, control, integration and auditability.
Questions to answer before design
What is the system of record? Where do rules live? Which data is sensitive? What evidence must be retained? Who owns operations after go-live?
Frequently asked question
Is there one correct design for every organization?
No. Final design depends on products, policy, existing systems, data, risk and the institution’s operating model.