OpenAI compatible API · Attested · Public status
DeepInfra performance
Review measured TTFT, effective throughput, uptime, and sampled model routes for DeepInfra on TrustedRouter using metadata-only production probes.
Onebase URL to migrate
100sof models and routes
0prompt or output logs. Always.
DeepInfradeepinfra
446 samples
Continuously sampled provider performance. TrustedRouter reports unsupported route and probe-configuration rows separately from provider downtime. Prompt and output content is not stored.
| p50 TTFT | 794 ms |
|---|---|
| p95 TTFT | 3585 ms |
| Effective throughput | 91 tok/s n=9 |
| Uptime | 99.78% |
Measured model routes
| Model | p50 TTFT | Effective throughput | Uptime | Config excluded | Availability samples |
|---|---|---|---|---|---|
| deepseek/deepseek-v4.1-flash | 794 ms | — | 99.61% | — | 256 |
| deepseek/deepseek-v4-flash-0731 | 804 ms | — | 100.00% | — | 17 |
| deepseek/deepseek-v4-flash | 914 ms | — | 100.00% | — | 14 |
| z-ai/glm-5.3-flash | 2146 ms | — | 100.00% | — | 49 |
| moonshotai/kimi-k3 | 2621 ms | 91 tok/s n=1 | 100.00% | — | 74 |
| xiaomi/mimo-v2.6-pro | 3407 ms | — | 100.00% | — | 19 |
| deepseek/deepseek-v4.1-flash-1017 | 545 ms | — | 100.00% | — | 4 |
| z-ai/glm-5.3 | 554 ms | 312 tok/s n=1 | 100.00% | — | 1 |
| z-ai/glm-5.2 | 561 ms | 74 tok/s n=2 | 100.00% | — | 1 |
| meta-llama/llama-3.3-70b-instruct-turbo | 832 ms | — | 100.00% | — | 1 |
| inclusionai/ling-3.0-flash-vl | 899 ms | — | 100.00% | — | 1 |
| qwen/qwen3-vl-235b-a22b-instruct | 950 ms | — | 100.00% | — | 1 |
| microsoft/phi-4 | 1209 ms | — | 100.00% | — | 1 |
| google/gemini-3.7-flash | 1396 ms | — | 100.00% | — | 1 |
| xiaomi/mimo-v2.6-flash | 2110 ms | — | 100.00% | — | 1 |
| google/gemma-3-4b-it | 2131 ms | — | 100.00% | — | 1 |
| qwen/qwen3.6-27b | 2238 ms | — | 100.00% | — | 1 |
| mistralai/mistral-small-24b-instruct-2501 | 2324 ms | — | 100.00% | — | 1 |
| qwen/qwen3.5-27b | 3585 ms | — | 100.00% | — | 1 |
| Qwen/Qwen3-Embedding-8B | — | — | 100.00% | — | 1 |
| deepseek/deepseek-v4-pro-0423 | — | 201 tok/s n=1 | — | — | 0 |
| google/gemma-4-31b-it | — | 38 tok/s n=1 | — | — | 0 |
| minimax/minimax-m3 | — | 130 tok/s n=2 | — | — | 0 |
| moonshotai/kimi-k2.6 | — | 50 tok/s n=1 | — | — | 0 |