Load Balance across

  • Azure OpenAI

  • Vertex AI

  • Bedrock

  • OpenAI

Load Balance across

  • Azure OpenAI

  • Vertex AI

  • Bedrock

  • OpenAI

Load Balance across

  • Azure OpenAI

  • Vertex AI

  • Bedrock

  • OpenAI

LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. all in the OpenAI format

LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. all in the OpenAI format

LiteLLM handles loadbalancing, fallbacks and spend tracking across 100+ LLMs. all in the OpenAI format

Try LiteLLM Cloud Free

Deploy LiteLLM Open Source

Try LiteLLM Cloud Free

Deploy Open Source

Try LiteLLM Cloud Free

Deploy LiteLLM Open Source

🚅 LiteLLM

Schedule Demo

Github 8.3K

40,000+

docker pulls

20M+

requests served

99%

uptime

150+

contributors

Add Model

Load Balance

Create Keys

Track Spend

🚅 LiteLLM

Product

Updates

Company

Contact

Resources

Community

Docs