Groq
Listed at https://console.groq.com
Overall Rank #13 ⭐ Consider
❌ Proxy required | 🌍 International
💰 Token Pricing
| Type | Price | Note |
|---|---|---|
| Input | Llama 3.3 70B: $0.59/M, DeepSeek-R1: $0.89/M, Mixtral 8x7B: $0.15/M | per million tokens |
| Output | Llama 3.3 70B: $0.79/M, DeepSeek-R1: $0.89/M, Mixtral 8x7B: $0.15/M | per million tokens |
💡 Free Credits:
🤖 Supported Models (12)
Llama 3.3 70BLlama 3.1 405BLlama 3.2 90BDeepSeek-R1Mixtral 8x7BGemma 2 9B
✨ Pros
- ✓LPU inference engine: Llama 3.3 70B reaches 1,250 tok/s
- ✓Industry's fastest inference speed
- ✓Llama 3.3 70B at $0.59/M input, excellent value
- ✓Generous free tier
- ✓OpenAI-compatible API, seamless migration
- ✓GroqCloud platform expanding model library
⚠️ Cons
- ×China requires proxy
- ×Limited model selection (mostly open-source)
- ×No Function Calling support
- ×LPU optimization limited for non-Meta models
- ×No overseas nodes, impacting global latency
🎯 Best For
Applications needing extreme inference speed; high-throughput real-time scenarios; high-performance open-source model deployment