LiteLLM

Listed at https://litellm.ai

Overall Rank #12 ⭐ Consider
✅ Open-source self-hosted, no restrictions | 🌍 International

💰 Token Pricing

TypePriceNote
Input 开源免费自部署;LiteLLM Cloud 按量计费 per million tokens
Output 开源免费自部署;LiteLLM Cloud 按量计费 per million tokens
💡 Free Credits:

🤖 Supported Models (100)

通过 Proxy 转发 100+ Provider 任意模型

✨ Pros

  • 100+ provider unified interface, popular open-source
  • Self-hosted free, data stays on private network
  • Provider fallback, load balancing, budget controls
  • One-click Docker deployment
  • Fast-growing active GitHub community
  • Custom provider and model mapping support

⚠️ Cons

  • ×Self-hosting requires ops (Docker/server)
  • ×No built-in SaaS observability
  • ×No encryption/Guardrails out of box
  • ×Advanced features need custom dev
  • ×Non-standard API provider adapters limited

🎯 Best For

Teams needing self-hosted API gateways; data privacy-sensitive apps; developers avoiding SaaS gateway fees