Llm gateway vs litellm
Decide whether you want to operate a proxy or buy a managed service. Test compatibility with your client, deployment requirements, retries and failure visibility before changing endpoints.
Evaluate on your own workload
- Choose representative requests and define acceptable answers.
- Record input/output tokens, latency, errors and fallback attempts.
- Compare total monthly cost and operational requirements.
- Run a small controlled rollout with a rollback path.
No savings, compliance status or provider compatibility is guaranteed by this guide.
Published vendor prices
USD; offers and taxes may vary. Model usage and hosting can be separate costs.
| Vendor | Plan and billing | Source and checked date |
|---|---|---|
| OpenRouter | Standard: 5.5% credit-purchase fee plus model usage | Vendor source · |
| Portkey | Developer free; Production $49/month | Vendor source · |
| LiteLLM | Open-source self-hosting; infrastructure and model usage extra | Vendor source · |
| Cloudflare AI Gateway | Core features free; unified billing has a 5% credit-purchase fee | Vendor source · |
Gateway documentation and current plan ladder · Estimate monthly model costs