litellm. Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

github.com/xingyaoww/litellm
by @xingyaoww

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.