AI Dev Tools

Litellm

Open Source Updated 24d ago

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost

pip install litellm

Did you build this?

Claim your listing to see exactly how many AI agents recommend this tool, your success rate, and more. Free, no commission, no fees.

Claim This Listing

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Save tools & get AI recommendations

Free forever. No credit card required.

Visit Website → ☆ Bookmark

Listed for free · No commission · Claim this listing

11 developers visited via IndieStack this month

𝕏 Share

ai-gatewayanthropicazure-openaibedrockgateway

View on GitHub ★ 40,570Python

Active — last commit 11d ago2103 open issues

✅ Actively maintained

Using this saves ~120k tokens vs building from scratch

Confirmed Works With

pillow · 3 confirmed

mcp · 2 confirmed

psutil · 2 confirmed

authlib · 2 confirmed

Something wrong? Log in to report.