Featured in Gartner® Report

The Enterprise AI Gateway

LiteLLM AI Gateway Architecture — User → LiteLLM → LLMs / MCP / Agents
LLM Gateway
Budgets & Rate Limits
MCP Gateway
RBAC & Usage Tracking by Key, Team, Org
Agent Gateway
Logging to Datadog & OpenTelemetry
Built-in and 3rd Party Guardrails
OIDC, SSO, Custom Authentication
240M+
docker pulls
1B+
requests served
80%
uptime
1,005+
contributors

Deploy in any environment

Self-hosted, on-prem, or in your cloud.

🏢

On-prem

☁️

Multi-Cloud

⚙️

Kubernetes

⛵

Helm

Features

All available on LiteLLM Open-Source.

🔑

Delegate access

LiteLLM Enterprise allows you to delegate access of teams and organizations to admins. Reducing the time you spend managing the proxy.

🎟️

Generate tokens on the fly

With OIDC/JWT Auth and 'group-based access', developers can generate temporary tokens to call models via LiteLLM. Reducing time spent managing keys and model access.

📊

Monitor Proxy in Production

LiteLLM Enterprise provides Prometheus Metrics, Support with SLA's, and additional alerting features, to help you guarantee reliability in production.

Trusted by

Customer logos

Ready for production?

Deploy LiteLLM in your environment and give your developers access to 100+ LLMs.

Request Pricing → Read the Docs →