LiteLLM

LiteLLM is an open-source LLM gateway that provides a unified interface to call over 100 LLM APIs using the OpenAI format. It simplifies multi-provider AI development by standardizing API calls, managing authentication, tracking spend, and enabling load balancing across providers like OpenAI, Anthropic, Google, and Azure. LiteLLM can be used as a Python SDK or deployed as a proxy server.

Threads