Lepton AI
Listed at https://lepton.ai
Overall Rank #19 ⭐ Consider
⚠️ Partially available (ap-northeast-1 Tokyo region is closest; China access requires proxy) | 🌍 International
💰 Token Pricing
| Type | Price | Note |
|---|---|---|
| Input | Llama 3.3 70B: $0.80/M; Llama 3.1 405B: $3.50/M; Qwen 2.5 72B: $0.80/M; DeepSeek-R1: $2.00/M | per million tokens |
| Output | Same rate as input for most models (symmetric pricing) | per million tokens |
| Cache Read | N/A (serverless GPU does not cache input) | Discounted |
💡 Free Credits: $5 in credits valid for 30 days (enough to fully evaluate any flagship model)
🤖 Supported Models (50)
Llama 3.3 70BLlama 3.1 405BQwen 2.5 72BQwen 2.5 Coder 32BDeepSeek V3 / R1Mixtral 8x22BMistral Large 2FLUX.1 [schnell] / [dev]Stable Diffusion 3.5 LargeWhisper Large V3BGE-M3 / BGE-LargeGTE-Qwen2 7B
✨ Pros
- ✓Multi-region data residency: pin inference to us-west-2, us-east-1, eu-west-1, or ap-northeast-1 (data never leaves the chosen AWS region)
- ✓OpenAI-compatible API: switch by changing base_url + api_key, no application-layer refactor
- ✓SOC 2 Type II + GDPR + HIPAA compliant with signed DPA for EU customers
- ✓Serverless per-token billing + Dedicated endpoints from $4.50/hour (cheaper above ~116M tokens/day)
- ✓50+ open-source models (Llama 3.1 405B, Qwen 2.5 72B, DeepSeek-R1, FLUX.1, Whisper V3)
- ✓Dedicated Enterprise tier for single-tenant private deployment (covers FedRAMP/ITAR)
⚠️ Cons
- ×Region is fixed at workspace creation and cannot be migrated later (use multiple workspaces for multi-region)
- ×Several flagship models (Llama 3.1 405B / DeepSeek-R1) not yet available in EU/JP regions
- ×$5 free credit smaller than Groq's daily free quota or GitHub Models' daily limits
- ×Closed models (GPT-5.5, Claude Opus, etc.) not hosted — use OpenRouter for aggregator access
- ×Serverless per-token billing advantage diminishes for sub-5s calls; dedicated only pays off above ~116M tokens/day
- ×China access requires proxy with cross-Pacific latency (no China-direct edge)
🎯 Best For
Teams needing OpenAI-compatible API with DPA / SOC 2 / GDPR compliance for customer security reviews; EU/JP/US cross-region inference workloads; production environments requiring Dedicated GPU SLA