Anyscale
Listed at https://endpoints.anyscale.com
Overall Rank #17 ⭐ Consider
❌ Proxy required | 🌍 International
💰 Token Pricing
| Type | Price | Note |
|---|---|---|
| Input | Llama 3.3 70B: $0.39/M, DeepSeek-R1: $1/M, Mixtral 8x22B: $0.90/M | per million tokens |
| Output | Llama 3.3 70B: $0.39/M, DeepSeek-R1: $1/M, Mixtral 8x22B: $0.90/M | per million tokens |
💡 Free Credits:
🤖 Supported Models (20)
Llama 3.3 70BLlama 3.1 405BMixtral 8x22BDeepSeek-R1CodeLlama 70BQwen 2.5 72B
✨ Pros
- ✓Llama 3.3 70B at only $0.39/M tokens, competitive
- ✓Built on Ray distributed framework, high availability
- ✓Unified API interface
- ✓Function Calling support
- ✓Enterprise SLA and support
⚠️ Cons
- ×China requires proxy
- ×Limited model selection (mostly open-source)
- ×UI/UX leans technical
- ×Brand recognition lower than Together AI
- ×Ray ecosystem complexity may impact user experience
🎯 Best For
AI developers needing stable open-source model endpoints; Ray ecosystem users; value-conscious enterprise users