LiteLLM
Listed at https://litellm.ai
Overall Rank #12 ⭐ Consider
✅ Open-source self-hosted, no restrictions | 🌍 International
💰 Token Pricing
| Type | Price | Note |
|---|---|---|
| Input | 开源免费自部署;LiteLLM Cloud 按量计费 | per million tokens |
| Output | 开源免费自部署;LiteLLM Cloud 按量计费 | per million tokens |
💡 Free Credits:
🤖 Supported Models (100)
通过 Proxy 转发 100+ Provider 任意模型
✨ Pros
- ✓100+ provider unified interface, popular open-source
- ✓Self-hosted free, data stays on private network
- ✓Provider fallback, load balancing, budget controls
- ✓One-click Docker deployment
- ✓Fast-growing active GitHub community
- ✓Custom provider and model mapping support
⚠️ Cons
- ×Self-hosting requires ops (Docker/server)
- ×No built-in SaaS observability
- ×No encryption/Guardrails out of box
- ×Advanced features need custom dev
- ×Non-standard API provider adapters limited
🎯 Best For
Teams needing self-hosted API gateways; data privacy-sensitive apps; developers avoiding SaaS gateway fees