What is Model Gateway?
AI InfrastructureLast updated:
A routing layer that sits between applications and multiple AI model providers, handling auth, load balancing, and failover.
Model gateways like LiteLLM, Portkey, and custom solutions provide a unified API across OpenAI, Anthropic, Google, and self-hosted models. They enable provider switching, cost tracking, rate limiting, and fallback routing without changing application code.