Measured performance
Provider & model performance
Measured time-to-first-token, effective throughput, and uptime for every LLM provider and model TrustedRouter routes to — continuously sampled, not vendor-claimed.
Last updated
2026-09-08T11:34:37.359Z
Continuously sampled from TrustedRouter's monitor regions using a
rolling benchmark set of up to 10,000 samples. Time-to-first-token (TTFT),
effective throughput, and success rate come from real
streaming requests, not vendor claims. Completion rate shows the end-user result.
Provider availability excludes failures owned by TrustedRouter, customers, or route
configuration, while still reporting those failures under their actual owner.
Capacity acceptance measures requests not rejected for provider overload. Effective throughput is provider-reported
output tokens divided by complete request time, so buffered delivery cannot inflate
the result. Unsupported route and probe-configuration rows are reported separately
and do not count as provider downtime. No prompt or output content is ever stored.
Providers
Ranked by p50 time-to-first-token across all of a provider's models. Provider-attributed availability remains visible and breaks latency ties (56 providers · 3730 availability samples · 205 sustained throughput samples). Providers below the evidence floor remain visible as warming, but do not receive a rank.
| # | Provider | Models | Completion | Provider availability | Within deadline | Capacity accepted | p50 TTFT | p95 TTFT | Effective throughput | Failure owner | Config excluded | Samples |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | fireworks | 18 | 98.95% | 98.95% | 90.00% | 100.00% | 990 ms | 7440 ms | 57 tok/s | provider 3 |
— | 287 |
| 2 | together | 8 | 100.00% | 100.00% | 100.00% | 100.00% | 995 ms | 9692 ms | 90 tok/s | — | — | 31 |
| 3 | stepfun | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 1093 ms | 4748 ms | 29 tok/s | — | — | 31 |
| 4 | grok | 6 | 87.23% | 87.23% | 85.00% | 100.00% | 1145 ms | 2286 ms | 59 tok/s | provider 6 |
— | 47 |
| 5 | google-ai-studio | 9 | 100.00% | 100.00% | 100.00% | 100.00% | 1181 ms | 3609 ms | 42 tok/s | — | — | 30 |
| 6 | google-vertex | 10 | 100.00% | 100.00% | 100.00% | 100.00% | 1277 ms | 4099 ms | 70 tok/s | — | — | 30 |
| 7 | parasail | 17 | 93.55% | 93.55% | 93.55% | 93.55% | 1308 ms | 3061 ms | 65 tok/s | provider 2 |
— | 31 |
| 8 | telnyx | 13 | 97.44% | 97.44% | 97.30% | 100.00% | 1389 ms | 2856 ms | 98 tok/s | provider 1 |
— | 39 |
| 9 | pearl | 3 | 96.88% | 96.88% | 96.88% | 100.00% | 1409 ms | 3688 ms | 102 tok/s | provider 1 |
— | 32 |
| 10 | digitalocean | 17 | 97.50% | 97.50% | 97.50% | 100.00% | 1411 ms | 5121 ms | 57 tok/s | provider 1 |
— | 40 |
| 11 | lightning | 15 | 70.00% | 70.00% | 70.00% | 100.00% | 1452 ms | 3417 ms | 49 tok/s | provider 12 |
— | 40 |
| 12 | io-net | 22 | 100.00% | 100.00% | 100.00% | 100.00% | 1478 ms | 4062 ms | 60 tok/s | — | — | 30 |
| 13 | databricks | 7 | 100.00% | 100.00% | 100.00% | 100.00% | 1530 ms | 3002 ms | — | — | — | 30 |
| 14 | baseten | 11 | 99.39% | 99.39% | 99.39% | 100.00% | 1610 ms | 4098 ms | 78 tok/s | provider 3 |
— | 493 |
| 15 | anthropic | 11 | 100.00% | 100.00% | 100.00% | 100.00% | 1717 ms | 4998 ms | 56 tok/s | — | — | 40 |
| 16 | akashml | 7 | 82.35% | 82.35% | 82.35% | 100.00% | 1808 ms | 6805 ms | 98 tok/s | provider 6 |
— | 34 |
| 17 | alibaba | 42 | 100.00% | 100.00% | 100.00% | 100.00% | 1820 ms | 2883 ms | 68 tok/s | — | — | 44 |
| 18 | nvidia-nim | 12 | 60.61% | 60.61% | 60.61% | 100.00% | 1950 ms | 10057 ms | 26 tok/s | provider 13 |
— | 33 |
| 19 | inceptron | 6 | 81.25% | 81.25% | 81.25% | 100.00% | 1958 ms | 17557 ms | 61 tok/s | provider 6 |
— | 32 |
| 20 | novita | 33 | 87.10% | 87.10% | 87.10% | 96.77% | 1995 ms | 3044 ms | 57 tok/s | provider 4 |
— | 31 |
| 21 | siliconflow | 27 | 95.74% | 95.74% | 95.74% | 100.00% | 2066 ms | 6106 ms | 54 tok/s | provider 2 |
— | 47 |
| 22 | openai | 20 | 100.00% | 100.00% | 100.00% | 100.00% | 2080 ms | 3407 ms | — | — | — | 79 |
| 23 | cerebras | 4 | 99.02% | 99.02% | 98.46% | 100.00% | 2091 ms | 4605 ms | 374 tok/s | provider 1 |
25 probe_config_error |
102 |
| 24 | relace | 2 | 100.00% | 100.00% | 100.00% | 100.00% | 2123 ms | 5613 ms | 77 tok/s | — | — | 37 |
| 25 | thinkingmachines | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 2123 ms | 3873 ms | 40 tok/s | — | — | 33 |
| 26 | deepseek | 5 | 99.20% | 99.20% | 98.92% | 100.00% | 2142 ms | 4352 ms | — | provider 4 |
— | 500 |
| 27 | deepinfra | 35 | 98.18% | 98.18% | 97.06% | 100.00% | 2142 ms | 6301 ms | 29 tok/s | provider 1 |
— | 55 |
| 28 | venice | 29 | 91.30% | 91.30% | 88.64% | 97.83% | 2143 ms | 9639 ms | 37 tok/s | provider 4 |
— | 46 |
| 29 | zero-g | 3 | 100.00% | 100.00% | 100.00% | 100.00% | 2202 ms | 3872 ms | 65 tok/s | — | — | 40 |
| 30 | wafer | 5 | 95.12% | 95.12% | 94.74% | 100.00% | 2335 ms | 7433 ms | 54 tok/s | provider 2 |
— | 41 |
| 31 | azure | 8 | 100.00% | 100.00% | 100.00% | 100.00% | 2424 ms | 4971 ms | 49 tok/s | — | — | 32 |
| 32 | perplexity | 1 | 100.00% | 100.00% | 100.00% | 100.00% | 2473 ms | 5285 ms | — | — | — | 31 |
| 33 | minimax | 6 | 100.00% | 100.00% | 100.00% | 100.00% | 2483 ms | 10158 ms | 52 tok/s | — | — | 34 |
| 34 | morph | 8 | 71.79% | 71.79% | 71.79% | 79.49% | 2508 ms | 5446 ms | 38 tok/s | provider 11 |
— | 39 |
| 35 | tinfoil | 7 | 93.33% | 93.33% | 93.24% | 100.00% | 2762 ms | 5276 ms | 63 tok/s | provider 5 |
— | 75 |
| 36 | zai | 12 | 98.11% | 98.11% | 97.78% | 100.00% | 3168 ms | 8292 ms | 44 tok/s | provider 1 |
— | 53 |
| 37 | nebius | 13 | 100.00% | 100.00% | 100.00% | 100.00% | 3206 ms | 11999 ms | 86 tok/s | — | — | 71 |
| 38 | arcee | 7 | 100.00% | 100.00% | 100.00% | 100.00% | 3784 ms | 9374 ms | 44 tok/s | — | — | 32 |
| 39 | kimi | 4 | 100.00% | 100.00% | 100.00% | 100.00% | 4491 ms | 5195 ms | 37 tok/s | — | — | 98 |
| — | friendli warming | 7 | 100.00% | 100.00% | 100.00% | 100.00% | 1073 ms | 4762 ms | 85 tok/s | — | — | 26 |
| — | cloudflare-workers-ai warming | 14 | 100.00% | 100.00% | 100.00% | 100.00% | 1158 ms | 2188 ms | 27 tok/s | — | — | 27 |
| — | mistral warming | 4 | 100.00% | 100.00% | 100.00% | 100.00% | 1193 ms | 2354 ms | 55 tok/s | — | — | 29 |
| — | engy warming | 6 | 100.00% | 100.00% | 100.00% | 100.00% | 1248 ms | 2608 ms | 38 tok/s | — | — | 21 |
| — | makora warming | 4 | 75.00% | 75.00% | 75.00% | 100.00% | 1304 ms | 4849 ms | 89 tok/s | provider 3 |
8 probe_config_error |
12 |
| — | scaleway warming | 8 | 100.00% | 100.00% | 100.00% | 100.00% | 1339 ms | 5491 ms | 52 tok/s | — | 2 probe_config_error |
19 |
| — | wandb warming | 16 | 100.00% | 100.00% | 100.00% | 100.00% | 1572 ms | 2821 ms | 70 tok/s | — | 5 probe_config_error |
25 |
| — | phala warming | 5 | 35.71% | 35.71% | 35.71% | 100.00% | 2149 ms | 13268 ms | 25 tok/s | provider 18 |
— | 28 |
| — | nscale warming | 7 | 100.00% | 100.00% | 100.00% | 100.00% | 2182 ms | 3797 ms | 60 tok/s | — | — | 26 |
| — | featherless warming | 12 | 84.21% | 84.21% | 84.21% | 100.00% | 2417 ms | 10435 ms | 118 tok/s | provider 3 |
7 probe_config_error |
19 |
| — | xiaomi warming | 3 | 88.46% | 88.46% | 88.46% | 100.00% | 3189 ms | 13931 ms | 27 tok/s | provider 3 |
— | 26 |
| — | gmi warming | 6 | 96.55% | 96.55% | 96.55% | 100.00% | 3531 ms | 5757 ms | 38 tok/s | provider 1 |
2 unsupported_route |
29 |
| — | near-ai warming | 9 | 8.00% | 8.00% | 8.00% | 100.00% | 3644 ms | 5503 ms | 28 tok/s | provider 23 |
— | 25 |
| — | sakana warming | 1 | 70.00% | 100.00% | 100.00% | 100.00% | 5775 ms | 11996 ms | — | trustedrouter 6 |
19 probe_config_error |
14 |
| — | chutes warming | 8 | 44.44% | 44.44% | 44.44% | 100.00% | 9327 ms | 30452 ms | 22 tok/s | provider 15 |
— | 27 |
| — | jina warming | 1 | 100.00% | 100.00% | — | 100.00% | — | — | — | — | — | 27 |
| — | neurometric warming | 1 | 100.00% | 100.00% | — | 100.00% | — | — | — | — | — | 500 |
Models
Qualified models are ranked by p50 TTFT, with provider-attributed availability as a tie-breaker. Thin availability and throughput measurements stay visible below the ranked set as warming.
| # | Model | Provider | Completion | Provider availability | Within deadline | Capacity accepted | p50 TTFT | p95 TTFT | Effective throughput | Config excluded | Samples |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | cerebras/gpt-oss-120b | cerebras | 90.00% | 90.00% | 90.00% 15s | 100.00% | 984 ms | 2245 ms | 374 tok/s warming | — | 10 |
| 2 | z-ai/glm-5.3 | akashml | 100.00% | 100.00% | 100.00% 45s | 100.00% | 988 ms | 3661 ms | — | — | 10 |
| 3 | stepfun/step-3.5-flash-2603 | stepfun | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1013 ms | 2631 ms | — | — | 12 |
| 4 | x-ai/grok-4.20-reasoning | grok | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1119 ms | 12671 ms | — | — | 10 |
| 5 | z-ai/glm-5.3-flash | wafer | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1281 ms | 12698 ms | — | — | 10 |
| 6 | zero-g/0gm-1.0-35b-a3b | zero-g | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1397 ms | 3257 ms | — | — | 12 |
| 7 | z-ai/glm-5.3 | pearl | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1409 ms | 2692 ms | — | — | 12 |
| 8 | z-ai/glm-5.3 | wafer | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1454 ms | 7433 ms | — | — | 10 |
| 9 | x-ai/grok-4.6 | grok | 66.67% | 66.67% | 45.45% 20s | 100.00% | 1455 ms | 2211 ms | 59 tok/s warming | — | 18 |
| 10 | deepseek/deepseek-v4-flash-vision-exp | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1547 ms | 2118 ms | — | — | 227 |
| 11 | thinkingmachines/inkling-small | thinkingmachines | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1569 ms | 3209 ms | — | — | 10 |
| 12 | deepseek/deepseek-v4-flash-0731 | baseten | 99.37% | 99.37% | 99.37% 20s | 100.00% | 1610 ms | 4098 ms | 102 tok/s warming | — | 476 |
| 13 | moonshotai/kimi-k2.6 | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1632 ms | 2751 ms | 50 tok/s warming | — | 12 |
| 14 | moonshotai/kimi-k2.7-code-highspeed | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1691 ms | 2841 ms | — | — | 11 |
| 15 | minimax/minimax-m2.7 | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1692 ms | 10243 ms | — | — | 10 |
| 16 | moonshotai/kimi-k3 | relace | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1725 ms | 5613 ms | 77 tok/s warming | — | 16 |
| 17 | openai/gpt-oss-120b | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1811 ms | 3678 ms | — | — | 11 |
| 18 | qwen/qwen3.8-27b | cerebras | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2091 ms | 4605 ms | — | 16 probe_config_error |
68 |
| 19 | openai/gpt-5.6-luna | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2098 ms | 3557 ms | — | — | 33 |
| 20 | deepseek/deepseek-v4-flash-0731 | relace | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2123 ms | 2982 ms | 97 tok/s warming | — | 21 |
| 21 | z-ai/glm-5.3 | thinkingmachines | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2123 ms | 4023 ms | — | — | 11 |
| 22 | deepseek/deepseek-v4-flash-0731 | deepseek | 98.40% | 98.40% | 96.72% 20s | 100.00% | 2142 ms | 5685 ms | — | — | 250 |
| 23 | qwen/qwen2.5-coder-3b-instruct | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2182 ms | 2448 ms | — | — | 10 |
| 24 | zero-g/0gm-1.0-35b-a3b-sia | zero-g | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2202 ms | 4034 ms | — | — | 13 |
| 25 | perplexity/sonar | perplexity | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2473 ms | 5285 ms | — | — | 31 |
| 26 | stepfun/step-3.7-flash | stepfun | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2485 ms | 5706 ms | 29 tok/s warming | — | 14 |
| 27 | deepseek/deepseek-v4-flash | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2551 ms | 4767 ms | — | — | 13 |
| 28 | deepseek/deepseek-v4-flash | tinfoil | 88.64% | 88.64% | 88.64% 20s | 100.00% | 2762 ms | 6707 ms | 58 tok/s warming | — | 44 |
| 29 | z-ai/glm-5.3 | zero-g | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2893 ms | 3910 ms | 65 tok/s warming | — | 15 |
| 30 | thinkingmachines/inkling | thinkingmachines | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2967 ms | 3873 ms | 40 tok/s warming | — | 12 |
| 31 | z-ai/glm-5.3-flash | pearl | 91.67% | 91.67% | 91.67% 45s | 100.00% | 3128 ms | 3755 ms | — | — | 12 |
| 32 | z-ai/glm-5.3-flash | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3147 ms | 7240 ms | — | — | 11 |
| 33 | xiaomi/mimo-v2.5 | xiaomi | 90.91% | 90.91% | 90.91% 20s | 100.00% | 3189 ms | 13931 ms | — | — | 11 |
| 34 | deepseek/deepseek-v4-flash-0731 | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3206 ms | 8590 ms | 77 tok/s warming | — | 52 |
| 35 | moonshotai/kimi-k3 | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4491 ms | 5761 ms | 23 tok/s warming | — | 71 |
| 36 | sakana-ai/fugu-ultra-v1.1 | sakana | 70.00% | 100.00% | 100.00% 20s | 100.00% | 5775 ms | 11996 ms | — | 19 probe_config_error |
14 |
| 37 | xiaomi/mimo-v2.5-pro | xiaomi | 84.62% | 84.62% | 84.62% 20s | 100.00% | 6289 ms | 18461 ms | 27 tok/s warming | — | 13 |
| 38 | z-ai/glm-5.3 | zai | 92.31% | 92.31% | 91.67% 45s | 100.00% | 7084 ms | 9545 ms | — | — | 13 |
| — | qwen/qwen3.5-27b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 387 ms | 2246 ms | — | — | 2 |
| — | qwen/qwen3-vl-30b-a3b-instruct warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 455 ms | 455 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | friendli | 100.00% | 100.00% | 100.00% 45s | 100.00% | 547 ms | 1794 ms | 85 tok/s warming | — | 2 |
| — | google/gemini-2.5-flash-lite warming | google-vertex | 100.00% | 100.00% | 100.00% 15s | 100.00% | 567 ms | 567 ms | — | — | 2 |
| — | google/gemini-3.5-flash-lite warming | google-ai-studio | 100.00% | 100.00% | 100.00% 15s | 100.00% | 654 ms | 1211 ms | — | — | 2 |
| — | google/gemma-4-31b-it warming | tinfoil | 100.00% | 100.00% | 100.00% 20s | 100.00% | 685 ms | 1489 ms | 67 tok/s warming | — | 4 |
| — | nvidia/nemotron-3-nano-30b-a3b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 691 ms | 691 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | parasail | 100.00% | 100.00% | 100.00% 45s | 100.00% | 693 ms | 793 ms | 87 tok/s warming | — | 2 |
| — | deepseek/deepseek-v4-flash-0731 warming | pearl | 100.00% | 100.00% | 100.00% 20s | 100.00% | 707 ms | 2393 ms | 102 tok/s warming | — | 8 |
| — | thinkingmachines/inkling warming | deepinfra | 100.00% | 100.00% | 100.00% 45s | 100.00% | 707 ms | 1371 ms | — | — | 2 |
| — | nvidia/nemotron-nano-12b-v2-vl warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 719 ms | 773 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 730 ms | 730 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | io-net | 100.00% | 100.00% | 100.00% 45s | 100.00% | 743 ms | 2505 ms | 70 tok/s warming | — | 2 |
| — | mistralai/ministral-3-14b-instruct warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 751 ms | 751 ms | — | — | 1 |
| — | openai/gpt-4.1 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 762 ms | 3090 ms | — | — | 2 |
| — | openai/gpt-oss-20b warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 763 ms | 763 ms | — | — | 1 |
| — | qwen/qwen3.8-2.4t-a95b warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 776 ms | 776 ms | — | — | 1 |
| — | openpipe/qwen3-14b-instruct warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 781 ms | 781 ms | — | — | 1 |
| — | nvidia/nemotron-3.5-lightning warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 809 ms | 2115 ms | — | — | 2 |
| — | google/gemini-3.1-flash-lite warming | google-ai-studio | 100.00% | 100.00% | 100.00% 15s | 100.00% | 816 ms | 2419 ms | — | — | 4 |
| — | google/gemini-2.5-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 832 ms | 1386 ms | — | — | 2 |
| — | z-ai/glm-5.3 warming | telnyx | 100.00% | 100.00% | 100.00% 45s | 100.00% | 832 ms | 832 ms | — | — | 1 |
| — | qwen/qwen3.6-27b warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 837 ms | 3322 ms | — | — | 2 |
| — | openai/gpt-5.4-mini warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 849 ms | 963 ms | — | — | 2 |
| — | z-ai/glm-5.3-flash warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 863 ms | 863 ms | — | — | 1 |
| — | z-ai/glm-4.7-flash warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 873 ms | 873 ms | — | — | 1 |
| — | google/gemini-3.6-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 874 ms | 1412 ms | 69 tok/s warming | — | 2 |
| — | openai/gpt-oss-120b warming | cerebras | 100.00% | 100.00% | 100.00% 20s | 100.00% | 881 ms | 1984 ms | — | — | 7 |
| — | meta-models/muse-glimmer-30b warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 886 ms | 886 ms | — | — | 1 |
| — | meta-llama/llama-3.1-70b-instruct warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 897 ms | 1464 ms | — | — | 3 |
| — | lightning-ai/deepseek-v4-pro warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 903 ms | 1577 ms | — | — | 2 |
| — | morph/morph-v3-fast warming | morph | 40.00% | 40.00% | 40.00% 15s | 100.00% | 906 ms | 2236 ms | — | — | 5 |
| — | z-ai/glm-5.2 warming | engy | 100.00% | 100.00% | 100.00% 45s | 100.00% | 909 ms | 1018 ms | 32 tok/s warming | — | 2 |
| — | Qwen/Qwen3-235B-A22B-Instruct-2507 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 910 ms | 13340 ms | — | — | 2 |
| — | lightning-ai/gpt-oss-120b warming | lightning | 15.38% | 15.38% | 15.38% 20s | 100.00% | 915 ms | 915 ms | — | — | 13 |
| — | x-ai/grok-build-0.1 warming | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 919 ms | 1106 ms | — | — | 2 |
| — | x-ai/grok-4.5 warming | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 920 ms | 2267 ms | — | — | 6 |
| — | openai/gpt-oss-20b warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 921 ms | 1245 ms | — | — | 2 |
| — | z-ai/glm-5.2 warming | together | 100.00% | 100.00% | 100.00% 45s | 100.00% | 932 ms | 1673 ms | 135 tok/s warming | — | 2 |
| — | stepfun-ai/step-3.7-flash warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 935 ms | 935 ms | — | — | 1 |
| — | google/gemma-4-26b-a4b-it warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 938 ms | 2135 ms | — | — | 2 |
| — | z-ai/glm-5.3-flash warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 944 ms | 944 ms | — | — | 1 |
| — | NousResearch/Hermes-4-405B warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 954 ms | 3429 ms | — | — | 2 |
| — | cohere/command-a warming | azure | 100.00% | 100.00% | 100.00% 20s | 100.00% | 955 ms | 2216 ms | — | — | 2 |
| — | deepseek/deepseek-v4-pro warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 969 ms | 1228 ms | — | — | 2 |
| — | inclusionai/ling-3.0-flash-fin warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 973 ms | 2257 ms | — | — | 2 |
| — | moonshotai/kimi-k2.7-code warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 973 ms | 1038 ms | 75 tok/s warming | — | 2 |
| — | openai/gpt-4.1-mini warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 983 ms | 2357 ms | — | — | 3 |
| — | z-ai/glm-5.3-fast warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 985 ms | 1082 ms | — | — | 3 |
| — | deepseek/deepseek-v4-flash warming | featherless | 100.00% | 100.00% | 100.00% 20s | 100.00% | 988 ms | 3222 ms | 141 tok/s warming | — | 2 |
| — | z-ai/glm-5.2-fast warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 990 ms | 990 ms | 134 tok/s warming | — | 255 |
| — | minimax/minimax-m3 warming | parasail | 66.67% | 66.67% | 66.67% 20s | 66.67% | 992 ms | 3061 ms | 96 tok/s warming | — | 3 |
| — | minimax/minimax-m3 warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 995 ms | 995 ms | 90 tok/s warming | — | 16 |
| — | meta-llama/llama-3.2-3b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 996 ms | 1018 ms | — | — | 2 |
| — | moonshotai/kimi-k2.6 warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1001 ms | 1636 ms | 57 tok/s warming | — | 2 |
| — | thedrummer/skyfall-36b-v2 warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1002 ms | 2578 ms | — | — | 2 |
| — | meta-llama/llama-3.2-1b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1004 ms | 1440 ms | — | — | 2 |
| — | minimax/minimax-m3-preview warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1016 ms | 3232 ms | — | — | 2 |
| — | z-ai/glm-5.3-flash warming | friendli | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1019 ms | 2030 ms | — | — | 4 |
| — | openai/gpt-oss-20b warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1020 ms | 1020 ms | — | — | 1 |
| — | qwen/qwen3.5-122b-a10b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1026 ms | 1026 ms | — | — | 1 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1029 ms | 1246 ms | — | — | 2 |
| — | qwen/qwen3-vl-235b-a22b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1029 ms | 1114 ms | — | — | 2 |
| — | anthropic/claude-haiku-4.5 warming | anthropic | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1030 ms | 1515 ms | — | — | 4 |
| — | nvidia/nemotron-3-super-120b warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1035 ms | 1935 ms | — | — | 2 |
| — | z-ai/glm-5.1 warming | friendli | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1044 ms | 9396 ms | — | — | 3 |
| — | openai/gpt-5.1 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1056 ms | 1171 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1066 ms | 1699 ms | — | — | 3 |
| — | gryphe/mythomax-l2-13b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1067 ms | 1503 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1067 ms | 1951 ms | — | — | 2 |
| — | google/gemma-4-31b-it warming | friendli | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1073 ms | 1550 ms | 131 tok/s warming | — | 4 |
| — | openai/gpt-5.6-sol warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1074 ms | 1529 ms | — | — | 2 |
| — | moonshotai/kimi-k3 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1075 ms | 1075 ms | 32 tok/s warming | — | 1 |
| — | qwen/qwen3-6-35b-a3b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1083 ms | 1352 ms | — | — | 2 |
| — | google/gemma-4-31b-it warming | lightning | 50.00% | 50.00% | 50.00% 20s | 100.00% | 1087 ms | 1087 ms | 175 tok/s warming | — | 2 |
| — | stepfun/step-3.5-flash warming | stepfun | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1093 ms | 2351 ms | — | — | 5 |
| — | deepseek/deepseek-v4-flash warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1098 ms | 2634 ms | — | — | 2 |
| — | deepseek/deepseek-v4-flash warming | makora | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1100 ms | 1100 ms | 89 tok/s warming | 3 probe_config_error |
1 |
| — | mistralai/codestral-2508 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1100 ms | 2354 ms | — | — | 7 |
| — | openai/gpt-4-0613 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1102 ms | 2113 ms | — | — | 2 |
| — | deepseek/deepseek-v4-flash-vision-exp warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1113 ms | 1113 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash-vision-exp warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1127 ms | 1127 ms | — | — | 1 |
| — | mistralai/mistral-nemo warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1133 ms | 1869 ms | — | — | 7 |
| — | qwen/qwen3-235b-a22b-thinking-2507 warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1143 ms | 1143 ms | — | — | 1 |
| — | x-ai/grok-4.3 warming | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1145 ms | 2009 ms | — | — | 6 |
| — | qwen/qwen2.5-coder-32b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1153 ms | 1153 ms | — | — | 1 |
| — | meta-llama/llama-3.1-8b-instruct-fp8 warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1158 ms | 1337 ms | — | — | 2 |
| — | meta-llama/llama-3.1-8b-instruct warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1160 ms | 2166 ms | — | — | 2 |
| — | google/gemini-3-flash-preview warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1169 ms | 1184 ms | — | — | 5 |
| — | deepseek/deepseek-v4-flash warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1174 ms | 2418 ms | 16 tok/s warming | — | 2 |
| — | mistralai/mistral-medium-3.5-128b warming | scaleway | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1175 ms | 1961 ms | — | — | 2 |
| — | deepseek/deepseek-v4-pro warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1177 ms | 1277 ms | — | — | 2 |
| — | google/gemini-3.6-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1181 ms | 2900 ms | — | — | 5 |
| — | qwen/qwen3-next-80b-a3b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1188 ms | 1188 ms | — | — | 1 |
| — | mistralai/mistral-small-2603 warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1193 ms | 2520 ms | — | — | 9 |
| — | x-ai/grok-4.20-non-reasoning warming | azure | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1201 ms | 2580 ms | — | — | 2 |
| — | ibm-granite/granite-4.0-h-micro warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1202 ms | 1953 ms | — | — | 4 |
| — | qwen/qwen3.6-35b-a3b warming | engy | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1203 ms | 1441 ms | — | — | 2 |
| — | google/gemini-3.5-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1208 ms | 1715 ms | 83 tok/s warming | — | 4 |
| — | moonshotai/kimi-k2.6 warming | azure | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1210 ms | 1804 ms | 146 tok/s warming | — | 3 |
| — | meta-llama/llama-3.1-8b-instruct warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1212 ms | 1212 ms | — | — | 1 |
| — | meta-llama/llama-3.1-8b-instruct warming | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1215 ms | 2231 ms | — | — | 4 |
| — | minimax/minimax-m3 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1224 ms | 1575 ms | 114 tok/s warming | — | 3 |
| — | moonshotai/kimi-k2.6 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1231 ms | 2147 ms | 167 tok/s warming | — | 3 |
| — | z-ai/glm-5.3-flash warming | telnyx | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1234 ms | 2583 ms | — | — | 4 |
| — | deepseek/deepseek-v4-flash-0731 warming | engy | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1237 ms | 2920 ms | 45 tok/s warming | — | 4 |
| — | nvidia/nemotron-3-ultra-550b warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1239 ms | 1435 ms | — | — | 2 |
| — | qwen/qwen3.7-max-2026-05-20 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1240 ms | 1240 ms | — | — | 1 |
| — | z-ai/glm-5.3-flash warming | engy | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1248 ms | 2272 ms | — | — | 5 |
| — | meta-llama/llama-3.3-70b-instruct-fp8-fast warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1250 ms | 1250 ms | — | — | 1 |
| — | google/gemma-3-12b-it warming | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1253 ms | 2941 ms | — | — | 4 |
| — | moonshotai/kimi-k2.7-code warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1253 ms | 2750 ms | 48 tok/s warming | — | 3 |
| — | deepseek/deepseek-v3.2 warming | friendli | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1258 ms | 4762 ms | — | — | 5 |
| — | mistralai/mistral-large warming | mistral | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1260 ms | 2322 ms | 55 tok/s warming | — | 6 |
| — | mistralai/pixtral-12b-2409 warming | scaleway | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1265 ms | 1525 ms | — | — | 3 |
| — | qwen/qwen3-vl-235b-a22b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1269 ms | 1354 ms | — | — | 2 |
| — | qwen/qwen3-vl-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1270 ms | 1270 ms | — | — | 1 |
| — | openai/gpt-4o warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1271 ms | 1271 ms | — | — | 1 |
| — | z-ai/glm-5 warming | digitalocean | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1271 ms | 2438 ms | — | — | 4 |
| — | jetbrains/mellum2-12b-a2.5b-instruct warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1276 ms | 1662 ms | — | — | 2 |
| — | google/gemini-3.5-flash-lite warming | google-vertex | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1277 ms | 2238 ms | — | — | 5 |
| — | mistralai/mistral-small-3.2-24b-instruct-2506 warming | scaleway | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1277 ms | 1294 ms | — | — | 2 |
| — | meta-llama/llama-3.3-70b-instruct warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1281 ms | 1281 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | akashml | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1282 ms | 1756 ms | — | — | 2 |
| — | qwen/qwen3-5-35b-a3b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1287 ms | 2424 ms | — | — | 2 |
| — | nvidia/nemotron-3_5-lightning warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1288 ms | 2020 ms | — | — | 2 |
| — | x-ai/grok-4.20 warming | grok | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1293 ms | 2286 ms | — | — | 5 |
| — | qwen/qwen3-vl-235b-a22b-instruct warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1302 ms | 1302 ms | — | — | 1 |
| — | qwen/qwen3-30b-a3b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1303 ms | 1303 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1304 ms | 1304 ms | — | — | 1 |
| — | z-ai/glm-5.3 warming | makora | 75.00% | 75.00% | 75.00% 45s | 100.00% | 1304 ms | 2703 ms | — | — | 4 |
| — | qwen/qwen2.5-vl-72b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1308 ms | 2753 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1316 ms | 1316 ms | — | — | 1 |
| — | qwen/qwen3.6-flash-2026-04-16 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1320 ms | 2215 ms | — | — | 2 |
| — | moonshotai/kimi-k2.7-code warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1326 ms | 2280 ms | 78 tok/s warming | — | 5 |
| — | z-ai/glm-5.1 warming | digitalocean | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1330 ms | 2482 ms | — | — | 2 |
| — | deepseek/deepseek-v4-flash-0731 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1331 ms | 3723 ms | 56 tok/s warming | — | 2 |
| — | moonshotai/kimi-k2.6 warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1333 ms | 1616 ms | — | — | 3 |
| — | deepseek/deepseek-v3.1 warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1335 ms | 1335 ms | — | — | 1 |
| — | qwen/qwen3-vl-flash-2025-10-15 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1338 ms | 1338 ms | — | — | 1 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | scaleway | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1339 ms | 1438 ms | — | — | 3 |
| — | deepseek/deepseek-v4-flash-0731 warming | inceptron | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1344 ms | 1958 ms | 70 tok/s warming | — | 4 |
| — | qwen/qwen3.6-plus warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1348 ms | 1348 ms | — | — | 1 |
| — | arcee-ai/trinity-large-thinking warming | arcee | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1350 ms | 2903 ms | — | — | 4 |
| — | lightning-ai/nemotron-3-ultra-550b-a55b warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1350 ms | 1585 ms | — | — | 2 |
| — | moonshotai/kimi-k2-thinking warming | io-net | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1353 ms | 1353 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1358 ms | 2992 ms | — | — | 6 |
| — | meta-llama/llama-3.3-70b-instruct warming | scaleway | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1359 ms | 1716 ms | — | — | 3 |
| — | openai/gpt-oss-20b warming | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1365 ms | 2077 ms | — | — | 2 |
| — | moonshotai/kimi-k3 warming | engy | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1370 ms | 2507 ms | 55 tok/s warming | — | 4 |
| — | anthropic/claude-sonnet-4.6 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1371 ms | 4568 ms | — | — | 4 |
| — | moonshotai/kimi-k2.6 warming | inceptron | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1371 ms | 1940 ms | — | — | 3 |
| — | google/gemini-3.5-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1375 ms | 2489 ms | — | — | 4 |
| — | anthropic/claude-opus-4.8 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1380 ms | 3040 ms | 87 tok/s warming | — | 5 |
| — | qwen/qwen3.5-35b-a3b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1385 ms | 1918 ms | — | — | 2 |
| — | meta-llama/llama-4-maverick-17b-128e-instruct-fp8 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1388 ms | 1388 ms | — | — | 1 |
| — | google/gemma-2b-it warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1389 ms | 2190 ms | — | — | 4 |
| — | minimax/minimax-m3 warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1391 ms | 1391 ms | 105 tok/s warming | — | 1 |
| — | moonshotai/Kimi-K2.7-Code warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1395 ms | 1395 ms | — | — | 1 |
| — | mistralai/mistral-small-3.1-24b-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1396 ms | 2060 ms | — | — | 3 |
| — | qwen/qwen3.8-max warming | fireworks | 57.14% | 57.14% | 25.00% 20s | 100.00% | 1407 ms | 1407 ms | — | — | 7 |
| — | meta-llama/llama-3.2-11b-vision-instruct warming | nvidia-nim | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1409 ms | 2095 ms | — | — | 2 |
| — | qwen/qwen3.5-397b-a17b warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1411 ms | 1415 ms | — | — | 3 |
| — | qwen/qwen3.5-27b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1413 ms | 1413 ms | — | — | 1 |
| — | moonshotai/kimi-k2.7-code warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1417 ms | 1417 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1423 ms | 1925 ms | — | — | 3 |
| — | bytedance/seed-2.0-code warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1426 ms | 1426 ms | — | — | 1 |
| — | nvidia/nemotron-3-nano-omni-30b-a3b-reasoning warming | nvidia-nim | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1428 ms | 2094 ms | — | — | 3 |
| — | openai/gpt-oss-120b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1431 ms | 1431 ms | — | — | 1 |
| — | inclusionai/ling-3.0-flash warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1441 ms | 1441 ms | — | — | 1 |
| — | qwen/qwen-mt-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1445 ms | 1445 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1452 ms | 1452 ms | 133 tok/s warming | — | 1 |
| — | openai/gpt-3.5-turbo warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1452 ms | 1452 ms | — | — | 1 |
| — | minimax/minimax-m2.7-highspeed warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1464 ms | 3413 ms | — | — | 4 |
| — | qwen/qwen3-coder-30b-a3b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1472 ms | 1472 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1473 ms | 2464 ms | — | — | 4 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1477 ms | 2029 ms | — | — | 2 |
| — | moonshotai/kimi-k2-instruct-0905 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1478 ms | 4009 ms | — | — | 5 |
| — | meta-llama/llama-4-maverick warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1490 ms | 2762 ms | — | — | 4 |
| — | z-ai/glm-5.2 warming | telnyx | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1497 ms | 1824 ms | 70 tok/s warming | — | 3 |
| — | thinkingmachines/inkling warming | together | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1500 ms | 2704 ms | — | — | 5 |
| — | qwen/qwen3-next-80b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1507 ms | 1507 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | telnyx | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1519 ms | 1519 ms | — | — | 1 |
| — | meta-llama/llama-4-scout-17b-16e-instruct warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1523 ms | 2190 ms | — | — | 4 |
| — | openai/gpt-oss-20b warming | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1530 ms | 1587 ms | — | — | 4 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1531 ms | 1531 ms | — | — | 1 |
| — | qwen/qwen3-vl-plus warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1533 ms | 1533 ms | — | — | 1 |
| — | google/gemini-3-flash-preview warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1535 ms | 2367 ms | — | — | 6 |
| — | zai-org/glm-4.6 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1537 ms | 3022 ms | — | — | 2 |
| — | qwen/qwen3.5-27b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1539 ms | 1539 ms | — | — | 1 |
| — | x-ai/grok-4.1-fast-non-reasoning warming | azure | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1543 ms | 3217 ms | — | — | 3 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1545 ms | 1704 ms | — | — | 3 |
| — | prism-ml/ternary-bonsai-27b warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1548 ms | 9692 ms | — | — | 2 |
| — | minimax/minimax-m3 warming | nvidia-nim | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1561 ms | 1561 ms | 35 tok/s warming | — | 1 |
| — | nvidia/nemotron-3-nano-30b-a3b-bf16 warming | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1561 ms | 1561 ms | — | — | 1 |
| — | anthropic/claude-opus-5 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1565 ms | 3896 ms | 56 tok/s warming | — | 2 |
| — | moonshotai/kimi-k2.7-code warming | kimi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1570 ms | 2553 ms | 55 tok/s warming | — | 4 |
| — | deepseek/deepseek-v4-flash warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1572 ms | 2388 ms | 45 tok/s warming | — | 3 |
| — | moonshotai/kimi-k2.7-code warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1575 ms | 1575 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro-0423 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1582 ms | 3329 ms | 32 tok/s warming | — | 2 |
| — | thedrummer/cydonia-24b-v4.1 warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1584 ms | 1584 ms | — | — | 1 |
| — | meta-llama/llama-3.3-70b-instruct warming | tinfoil | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1609 ms | 3044 ms | — | — | 2 |
| — | nvidia/nemotron-3-super-120b-a12b warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1611 ms | 1611 ms | — | — | 1 |
| — | z-ai/glm-4.7 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1620 ms | 1620 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | morph | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1620 ms | 2278 ms | 41 tok/s warming | — | 5 |
| — | lightning-ai/qwen3.8-27b warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1626 ms | 1998 ms | — | — | 3 |
| — | z-ai/glm-4.7-flash warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1631 ms | 1631 ms | — | — | 1 |
| — | google/gemma-4-26b-a4b-it warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1646 ms | 1646 ms | — | — | 1 |
| — | qwen/qwen3-vl-32b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1648 ms | 1648 ms | — | — | 1 |
| — | qwen/qwen3-next-80b-a3b-instruct warming | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1649 ms | 2635 ms | — | — | 2 |
| — | minimax/minimax-m2.5 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1650 ms | 3294 ms | — | — | 2 |
| — | z-ai/glm-4.6 warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1650 ms | 1650 ms | — | — | 1 |
| — | openai/gpt-oss-120b warming | tinfoil | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1653 ms | 3842 ms | — | — | 6 |
| — | moonshotai/kimi-k3-fast-api warming | venice | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1661 ms | 1661 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1667 ms | 2821 ms | — | — | 4 |
| — | openai/gpt-5 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1667 ms | 1667 ms | — | — | 1 |
| — | qwen/qwen3-next-80b-a3b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1667 ms | 3005 ms | — | — | 4 |
| — | openai/gpt-oss-120b warming | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1668 ms | 1668 ms | 60 tok/s warming | — | 1 |
| — | zai-org/GLM-5.2 warming | nebius | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1672 ms | 1672 ms | — | — | 1 |
| — | qwen/qwen3-30b-a3b-thinking-2507 warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1681 ms | 1681 ms | — | — | 1 |
| — | qwen/qwen3.6-35b-a3b warming | siliconflow | 66.67% | 66.67% | 66.67% 20s | 100.00% | 1683 ms | 2125 ms | — | — | 3 |
| — | z-ai/glm-5.3 warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1684 ms | 1684 ms | — | — | 1 |
| — | openai/gpt-4-turbo warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1687 ms | 1687 ms | — | — | 1 |
| — | openai/gpt-oss-120b-ultra warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1695 ms | 1695 ms | — | — | 1 |
| — | qwen/qwen-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1703 ms | 1703 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1709 ms | 2856 ms | — | — | 2 |
| — | google/gemini-3.1-flash-image-preview warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1710 ms | 3409 ms | — | — | 2 |
| — | openai/gpt-5-nano warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1711 ms | 4048 ms | — | — | 20 |
| — | moonshotai/kimi-k3 warming | venice | 50.00% | 50.00% | 50.00% 20s | 100.00% | 1711 ms | 4169 ms | 37 tok/s warming | — | 4 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1712 ms | 2257 ms | — | — | 2 |
| — | anthropic/claude-opus-4.7 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1717 ms | 2253 ms | — | — | 5 |
| — | openai/o3-mini warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1718 ms | 1718 ms | — | — | 1 |
| — | qwen/qwen3-coder-480b-a35b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1725 ms | 1725 ms | — | — | 1 |
| — | xiaomi/mimo-v2.5 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1738 ms | 1738 ms | — | — | 1 |
| — | qwen/qwen3.5-397b-a17b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1741 ms | 1741 ms | — | — | 1 |
| — | deepseek/deepseek-v3.1 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1747 ms | 1747 ms | — | — | 1 |
| — | z-ai/glm-5.3 warming | tinfoil | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1753 ms | 4831 ms | — | — | 8 |
| — | openai/gpt-oss-120b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1764 ms | 1764 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash-0731 warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1770 ms | 1770 ms | 109 tok/s warming | — | 1 |
| — | z-ai/glm-5.2 warming | wandb | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1786 ms | 1786 ms | 143 tok/s warming | — | 1 |
| — | z-ai/glm-5 warming | gmi | 80.00% | 80.00% | 80.00% 45s | 100.00% | 1790 ms | 4861 ms | — | — | 5 |
| — | qwen/qwen3-vl-235b-a22b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1802 ms | 1802 ms | — | — | 1 |
| — | z-ai/glm-5.3-flash warming | nebius | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1802 ms | 40643 ms | — | — | 4 |
| — | anthropic/claude-sonnet-4.5 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1803 ms | 1803 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro-0813 warming | baseten | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1808 ms | 1928 ms | 49 tok/s warming | — | 2 |
| — | openai/gpt-oss-120b warming | akashml | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1808 ms | 6805 ms | — | — | 5 |
| — | openai/gpt-4 warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1813 ms | 1919 ms | — | — | 2 |
| — | z-ai/glm-5.3 warming | friendli | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1815 ms | 2702 ms | — | — | 3 |
| — | nvidia/nemotron-3-ultra-550b-a55b warming | nvidia-nim | 50.00% | 50.00% | 50.00% 20s | 100.00% | 1815 ms | 1815 ms | — | — | 2 |
| — | moonshotai/kimi-k2.5 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1820 ms | 1820 ms | — | — | 1 |
| — | meta-llama/llama-4-maverick warming | databricks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1823 ms | 1823 ms | — | — | 1 |
| — | x-ai/grok-4.1-fast-reasoning warming | azure | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1823 ms | 2998 ms | — | — | 4 |
| — | ibm-granite/granite-4.1-8b warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1829 ms | 8793 ms | — | — | 3 |
| — | moonshotai/kimi-k2.5 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1832 ms | 1832 ms | — | — | 1 |
| — | qwen/qwen3.5-flash warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1842 ms | 1842 ms | — | — | 1 |
| — | google/gemma-4-12b-it warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1843 ms | 1843 ms | — | — | 1 |
| — | meta-llama/llama-4-maverick-17b-128e-instruct-fp8 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1843 ms | 1843 ms | — | — | 1 |
| — | mistralai/mistral-nemo-instruct-2407 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1845 ms | 1845 ms | — | — | 1 |
| — | google/gemini-3.8-flash warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1871 ms | 2644 ms | — | — | 3 |
| — | deepseek/deepseek-v4-flash-0731 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1874 ms | 1874 ms | 52 tok/s warming | — | 1 |
| — | qwen/qwen-flash-2025-07-28 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1880 ms | 1880 ms | — | — | 1 |
| — | tencent/hunyuan-a13b-instruct warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1883 ms | 1883 ms | — | — | 1 |
| — | moonshotai/kimi-k2.5 warming | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1905 ms | 3782 ms | — | — | 5 |
| — | z-ai/glm-5.2 warming | novita | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1905 ms | 1905 ms | 56 tok/s warming | — | 1 |
| — | moonshotai/kimi-k3 warming | together | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1909 ms | 1909 ms | 35 tok/s warming | — | 1 |
| — | qwen/qwen3-max-preview warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1913 ms | 1913 ms | — | — | 1 |
| — | qwen/qwen3-vl-32b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1922 ms | 1922 ms | — | — | 1 |
| — | openai/gpt-6-astra warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1929 ms | 1929 ms | — | — | 1 |
| — | tencent/hy3 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1931 ms | 2357 ms | — | — | 2 |
| — | z-ai/glm-5.3 warming | engy | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1932 ms | 2608 ms | — | — | 4 |
| — | deepseek/deepseek-v4-pro warming | gmi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1935 ms | 4537 ms | — | — | 3 |
| — | nvidia/nemotron-3-super-120b-a12b warming | nvidia-nim | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1942 ms | 2083 ms | — | — | 3 |
| — | morph/morph-v3-large warming | morph | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1944 ms | 2064 ms | — | — | 3 |
| — | moonshotai/Kimi-K2.6 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1950 ms | 2274 ms | — | — | 2 |
| — | openai/gpt-oss-20b warming | nvidia-nim | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1950 ms | 3942 ms | — | — | 4 |
| — | google/gemini-3.1-flash-lite warming | google-vertex | 100.00% | 100.00% | 100.00% 15s | 100.00% | 1955 ms | 1955 ms | — | — | 1 |
| — | google/gemma-4-31b-it-turbo warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1955 ms | 1955 ms | — | — | 1 |
| — | qwen/qwen3.5-9b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1957 ms | 2639 ms | — | — | 3 |
| — | moonshotai/kimi-k2-6 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1958 ms | 4245 ms | — | — | 2 |
| — | moonshotai/kimi-k2.7-code warming | inceptron | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1958 ms | 17557 ms | — | — | 8 |
| — | z-ai/glm-5.3-flash warming | featherless | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1960 ms | 6035 ms | — | — | 2 |
| — | qwen/qwen-mt-plus warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1961 ms | 2000 ms | — | — | 2 |
| — | deepseek-ai/DeepSeek-V4-Pro warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1962 ms | 2595 ms | — | — | 2 |
| — | moonshotai/kimi-k2.6 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1962 ms | 1962 ms | 50 tok/s warming | — | 1 |
| — | minimax/minimax-m2.5 warming | friendli | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1970 ms | 2299 ms | — | — | 5 |
| — | qwen/qwen3-next-80b-a3b-instruct warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1976 ms | 1976 ms | — | — | 1 |
| — | google/gemini-2.5-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1980 ms | 2302 ms | — | — | 2 |
| — | z-ai/glm-5.2 warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1980 ms | 2198 ms | 129 tok/s warming | — | 3 |
| — | google/gemma-4-31b-it warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1984 ms | 1984 ms | 68 tok/s warming | — | 1 |
| — | openai/gpt-5.5 warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 1987 ms | 1987 ms | — | — | 1 |
| — | qwen/qwen3.5-397b-a17b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 1995 ms | 2730 ms | — | — | 2 |
| — | qwen/qwen3-vl-8b-instruct warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2007 ms | 2007 ms | — | — | 1 |
| — | deepseek/deepseek-v3.2 warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2011 ms | 4577 ms | — | — | 4 |
| — | moonshotai/kimi-k3 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2012 ms | 2012 ms | 21 tok/s warming | — | 1 |
| — | openai/gpt-oss-20b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2027 ms | 2027 ms | — | — | 1 |
| — | lightning-ai/gpt-oss-20b warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2029 ms | 2563 ms | — | — | 3 |
| — | anthropic/claude-opus-4.6 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2032 ms | 2032 ms | — | — | 1 |
| — | qwen/qwen3.7-flash-2026-07-15 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2039 ms | 2039 ms | — | — | 1 |
| — | z-ai/glm-5.3 warming | inceptron | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2051 ms | 2656 ms | — | — | 3 |
| — | z-ai/glm-5v-turbo warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2066 ms | 2800 ms | — | — | 3 |
| — | openai/gpt-4.1 warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2067 ms | 2842 ms | — | — | 3 |
| — | z-ai/glm-4.5-air warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2068 ms | 2914 ms | — | — | 3 |
| — | moonshotai/kimi-k2.5 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2075 ms | 2535 ms | — | — | 3 |
| — | qwen/qwen3-235b-a22b-thinking-2507 warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2079 ms | 2079 ms | — | — | 1 |
| — | openai/gpt-3.5-turbo-1106 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2080 ms | 2080 ms | — | — | 1 |
| — | z-ai/glm-4.5v warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2085 ms | 4149 ms | — | — | 4 |
| — | minimax/minimax-m2.5 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2107 ms | 3143 ms | — | — | 2 |
| — | anthropic/claude-opus-4.5 warming | anthropic | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2118 ms | 2270 ms | — | — | 3 |
| — | openai/gpt-4o warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2122 ms | 2813 ms | — | — | 3 |
| — | deepseek/deepseek-v3.1 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2128 ms | 2128 ms | — | — | 1 |
| — | z-ai/glm-5v-turbo warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2133 ms | 2133 ms | — | — | 1 |
| — | bytedance/ui-tars-1.5-7b warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2138 ms | 2773 ms | — | — | 2 |
| — | qwen/qwen3.5-35b-a3b warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2142 ms | 2142 ms | — | — | 1 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2143 ms | 2143 ms | — | — | 1 |
| — | moonshotai/kimi-k3 warming | phala | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2149 ms | 11722 ms | 27 tok/s warming | — | 7 |
| — | xiaomi/mimo-v2.5-pro-ultraspeed warming | xiaomi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2152 ms | 2800 ms | — | — | 2 |
| — | openai/gpt-oss-120b warming | scaleway | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2163 ms | 2766 ms | — | — | 5 |
| — | google/gemini-2.5-flash warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2170 ms | 2170 ms | — | — | 1 |
| — | google/gemini-2.5-flash-lite-preview-06-17 warming | lightning | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2170 ms | 2170 ms | — | — | 1 |
| — | deepseek/deepseek-r1-distill-qwen-32b warming | cloudflare-workers-ai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2188 ms | 2188 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash-0731-fast warming | venice | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2196 ms | 2196 ms | — | — | 3 |
| — | minimax/minimax-m2.5 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2197 ms | 3455 ms | — | — | 2 |
| — | zai-org/glm-5 warming | novita | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2207 ms | 2207 ms | — | — | 1 |
| — | qwen/qwen3-max-2025-09-23 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2209 ms | 2209 ms | — | — | 1 |
| — | qwen/qwen3-30b-a3b-instruct-2507 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2213 ms | 2213 ms | — | — | 1 |
| — | qwen/qwen3.6-35b-a3b warming | akashml | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2215 ms | 3672 ms | — | — | 2 |
| — | microsoft/phi-4 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2229 ms | 2229 ms | — | — | 1 |
| — | qwen/qwen3-235b-a22b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2230 ms | 2230 ms | — | — | 1 |
| — | qwen/qwen3-vl-8b-instruct warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2239 ms | 2261 ms | — | — | 2 |
| — | qwen/qwen3-vl-8b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2239 ms | 2239 ms | — | — | 1 |
| — | z-ai/glm-5.3 warming | featherless | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2244 ms | 3069 ms | — | — | 3 |
| — | openai/gpt-5.2 warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2247 ms | 2247 ms | — | — | 1 |
| — | qwen/qwen3-32b warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2263 ms | 2263 ms | — | — | 2 |
| — | z-ai/glm-5.1 warming | gmi | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2268 ms | 4996 ms | — | — | 2 |
| — | moonshotai/kimi-k2.5 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2275 ms | 2275 ms | — | — | 1 |
| — | qwen/qwen2.5-coder-32b-instruct warming | nscale | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2276 ms | 3797 ms | — | — | 4 |
| — | qwen/qwen3-vl-235b-a22b-thinking warming | alibaba | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2300 ms | 2300 ms | — | — | 1 |
| — | minimax/minimax-m3 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2305 ms | 2305 ms | 57 tok/s warming | — | 1 |
| — | xiaomi/mimo-v2.5-pro warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2333 ms | 5121 ms | 42 tok/s warming | — | 2 |
| — | moonshotai/kimi-k3 warming | wafer | 88.89% | 88.89% | 88.89% 20s | 100.00% | 2335 ms | 3911 ms | 54 tok/s warming | — | 9 |
| — | moonshotai/kimi-k2.5 warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2356 ms | 2582 ms | — | — | 3 |
| — | tencent/hy3 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2361 ms | 3328 ms | — | — | 3 |
| — | deepseek/deepseek-v4-flash-0731-fast warming | wafer | 85.71% | 85.71% | 85.71% 15s | 100.00% | 2370 ms | 2829 ms | — | — | 7 |
| — | minimax/minimax-m2.5 warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2376 ms | 2857 ms | — | — | 2 |
| — | deepseek/deepseek-v3.2 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2398 ms | 2398 ms | — | — | 1 |
| — | moonshotai/kimi-k2.5 warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2398 ms | 2398 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | featherless | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2417 ms | 2660 ms | — | — | 2 |
| — | moonshotai/kimi-k2.7-code warming | azure | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2424 ms | 17230 ms | 49 tok/s warming | — | 9 |
| — | google/gemma-3-27b-it warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2425 ms | 2425 ms | — | — | 1 |
| — | mistralai/mistral-nemotron warming | nvidia-nim | 25.00% | 25.00% | 25.00% 20s | 100.00% | 2434 ms | 2434 ms | — | — | 4 |
| — | openai/gpt-4-turbo warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2438 ms | 2988 ms | — | — | 2 |
| — | openai/gpt-5-mini warming | openai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2461 ms | 2461 ms | — | — | 1 |
| — | z-ai/glm-5v-turbo warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2466 ms | 2467 ms | — | — | 2 |
| — | z-ai/glm-5.2 warming | akashml | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2476 ms | 4777 ms | 98 tok/s warming | — | 4 |
| — | moonshotai/kimi-k3 warming | telnyx | 85.71% | 85.71% | 85.71% 20s | 100.00% | 2477 ms | 2668 ms | 103 tok/s warming | — | 7 |
| — | google/gemma-4-31b-it warming | siliconflow | 50.00% | 50.00% | 50.00% 20s | 100.00% | 2482 ms | 2482 ms | 34 tok/s warming | — | 2 |
| — | minimax/minimax-m2.5-highspeed warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2483 ms | 2776 ms | — | — | 3 |
| — | moonshotai/kimi-k3-fast warming | fireworks | 100.00% | 100.00% | 100.00% 15s | 100.00% | 2485 ms | 2485 ms | — | — | 1 |
| — | google/gemma-4-31b-it warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2489 ms | 2601 ms | 42 tok/s warming | — | 2 |
| — | minimax/minimax-m2 warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2506 ms | 2506 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | morph | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2508 ms | 4219 ms | 28 tok/s warming | — | 8 |
| — | qwen/qwen3.5-397b-a17b warming | morph | 80.00% | 80.00% | 80.00% 20s | 80.00% | 2508 ms | 3943 ms | — | — | 5 |
| — | openai/gpt-oss-120b warming | parasail | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2519 ms | 2519 ms | — | — | 1 |
| — | minimax/minimax-m2.7 warming | morph | 66.67% | 66.67% | 66.67% 20s | 66.67% | 2519 ms | 8462 ms | — | — | 3 |
| — | meta-llama/llama-4-scout-17b-16e-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2523 ms | 2523 ms | — | — | 1 |
| — | nvidia/nemotron-3.5-lightning-30b-a3b warming | wandb | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2587 ms | 2587 ms | — | — | 1 |
| — | openai/o4-mini warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2602 ms | 2693 ms | — | — | 2 |
| — | qwen/qwen-vl-ocr-2025-11-20 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2603 ms | 2603 ms | — | — | 1 |
| — | anthropic/claude-fable-5 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2607 ms | 3405 ms | — | — | 4 |
| — | z-ai/glm-5.3 warming | parasail | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2617 ms | 2617 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | phala | 66.67% | 66.67% | 66.67% 45s | 100.00% | 2617 ms | 3521 ms | — | — | 3 |
| — | z-ai/glm-4.6v warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2623 ms | 3364 ms | — | — | 3 |
| — | openai/gpt-oss-120b-turbo warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2645 ms | 2645 ms | — | — | 1 |
| — | qwen/qwen-vl-ocr warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2646 ms | 2646 ms | — | — | 1 |
| — | minimax/minimax-m2.1-highspeed warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2652 ms | 3069 ms | — | — | 5 |
| — | deepseek/deepseek-v4-flash-0731 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2663 ms | 2663 ms | 86 tok/s warming | — | 1 |
| — | z-ai/glm-4.7 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2665 ms | 2665 ms | — | — | 3 |
| — | deepseek/deepseek-v4-pro-0813 warming | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2666 ms | 6468 ms | — | — | 5 |
| — | minimax/minimax-m2 warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2675 ms | 4500 ms | — | — | 5 |
| — | x-ai/grok-4.20-reasoning warming | azure | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2705 ms | 3906 ms | — | — | 6 |
| — | z-ai/glm-5.2 warming | digitalocean | 50.00% | 50.00% | 50.00% 45s | 100.00% | 2706 ms | 2706 ms | 63 tok/s warming | — | 2 |
| — | qwen/qwen-3-7-max warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2736 ms | 2736 ms | — | — | 1 |
| — | minimax/minimax-m27 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2738 ms | 2738 ms | — | — | 1 |
| — | z-ai/glm-4.5 warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2743 ms | 6447 ms | — | — | 2 |
| — | moonshotai/kimi-k3 warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2747 ms | 8100 ms | 44 tok/s warming | — | 3 |
| — | MiniMaxAI/MiniMax-M3 warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2757 ms | 2757 ms | — | — | 1 |
| — | qwen/qwen3-next-80b-a3b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2758 ms | 2758 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | fireworks | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2761 ms | 2832 ms | 57 tok/s warming | — | 3 |
| — | z-ai/glm-5 warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2766 ms | 5687 ms | — | — | 2 |
| — | openai/gpt-oss-20b warming | akashml | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2779 ms | 12205 ms | — | — | 5 |
| — | deepseek/deepseek-v4-flash-0731 warming | telnyx | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2788 ms | 2788 ms | 93 tok/s warming | — | 1 |
| — | deepseek/deepseek-v4-pro warming | arcee | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2790 ms | 3437 ms | — | — | 4 |
| — | qwen/qwen3-coder-30b-a3b-instruct warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2821 ms | 2821 ms | — | — | 1 |
| — | google/gemini-3.8-flash warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2840 ms | 3332 ms | — | — | 3 |
| — | qwen/qwen3-max warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2875 ms | 2875 ms | — | — | 1 |
| — | qwen/qwen3.7-max warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2883 ms | 2883 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | inceptron | 100.00% | 100.00% | 100.00% 45s | 100.00% | 2887 ms | 24152 ms | 51 tok/s warming | — | 8 |
| — | qwen/qwen-plus-2025-07-28 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2925 ms | 2925 ms | — | — | 1 |
| — | moonshotai/kimi-k2.7-code warming | featherless | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2960 ms | 3489 ms | — | — | 2 |
| — | deepseek/deepseek-v4-pro warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 2981 ms | 5234 ms | 26 tok/s warming | — | 2 |
| — | moonshotai/kimi-k2.6 warming | wafer | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3021 ms | 3339 ms | 49 tok/s warming | — | 5 |
| — | google/gemini-3.5-flash warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3024 ms | 3024 ms | 55 tok/s warming | — | 1 |
| — | qwen/qwen3.6-27b warming | novita | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3044 ms | 3044 ms | — | — | 1 |
| — | moonshotai/kimi-k2-7-code warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3071 ms | 3071 ms | — | — | 1 |
| — | minimax/minimax-m3 warming | minimax | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3100 ms | 10158 ms | 52 tok/s warming | — | 7 |
| — | deepseek/deepseek-r1-0528 warming | io-net | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3102 ms | 3102 ms | — | — | 1 |
| — | qwen/qwen3.6-27b warming | morph | 28.57% | 28.57% | 28.57% 20s | 28.57% | 3126 ms | 5086 ms | — | — | 7 |
| — | tencent/hy4-preview warming | gmi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3140 ms | 4434 ms | — | 2 unsupported_route |
3 |
| — | openai/o3 warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3155 ms | 3155 ms | — | — | 1 |
| — | openai/gpt-oss-20b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3156 ms | 3156 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | arcee | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3157 ms | 4010 ms | 54 tok/s warming | — | 6 |
| — | openai/gpt-5.6-terra warming | openai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3162 ms | 3162 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3168 ms | 4332 ms | 44 tok/s warming | — | 4 |
| — | qwen/qwen3.6-plus-2026-04-02 warming | alibaba | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3186 ms | 3186 ms | — | — | 1 |
| — | google/gemini-3.1-pro-preview warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3204 ms | 4099 ms | 70 tok/s warming | — | 4 |
| — | qwen/qwen3.5-122b-a10b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3223 ms | 3223 ms | — | — | 1 |
| — | minimax/minimax-m3 warming | morph | 66.67% | 66.67% | 66.67% 20s | 66.67% | 3293 ms | 5446 ms | 35 tok/s warming | — | 3 |
| — | z-ai/glm-5.1 warming | siliconflow | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3308 ms | 3308 ms | — | — | 1 |
| — | z-ai/glm-5.2-fast warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3314 ms | 3314 ms | 78 tok/s warming | — | 2 |
| — | z-ai/glm-4.5-air warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3317 ms | 3467 ms | — | — | 2 |
| — | moonshotai/kimi-k2.5 warming | azure | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3320 ms | 4971 ms | — | — | 3 |
| — | z-ai/glm-5.3-flash warming | tinfoil | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3328 ms | 4314 ms | — | — | 8 |
| — | google/gemini-2.5-pro warming | lightning | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3417 ms | 4111 ms | — | — | 2 |
| — | z-ai/glm-5 warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3466 ms | 4230 ms | — | — | 3 |
| — | deepseek/deepseek-v3.2-exp warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3518 ms | 3518 ms | — | — | 1 |
| — | moonshotai/kimi-k3 warming | gmi | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3531 ms | 5757 ms | 42 tok/s warming | — | 9 |
| — | deepseek/deepseek-v4-flash-0731 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3534 ms | 4907 ms | 43 tok/s warming | — | 4 |
| — | deepseek/deepseek-v3 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3563 ms | 3563 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | gmi | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3600 ms | 5876 ms | 33 tok/s warming | — | 7 |
| — | google/gemini-3.1-pro-preview warming | google-ai-studio | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3609 ms | 5747 ms | 42 tok/s warming | — | 3 |
| — | z-ai/glm-5.2 warming | near-ai | 66.67% | 66.67% | 66.67% 45s | 100.00% | 3644 ms | 5503 ms | 28 tok/s warming | — | 3 |
| — | z-ai/glm-5.3-flash warming | makora | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3657 ms | 4849 ms | — | 1 unsupported_route |
5 |
| — | z-ai/glm-5.2 warming | tinfoil | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3720 ms | 3776 ms | — | — | 3 |
| — | z-ai/glm-5.2 warming | arcee | 100.00% | 100.00% | 100.00% 45s | 100.00% | 3784 ms | 5182 ms | — | — | 6 |
| — | z-ai/glm-4.6 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3800 ms | 9122 ms | — | — | 3 |
| — | qwen/qwen-3-8-2-4t-a95b warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3857 ms | 3857 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro warming | deepseek | 100.00% | 100.00% | 100.00% 20s | 100.00% | 3878 ms | 4413 ms | — | — | 5 |
| — | z-ai/glm-5.1 warming | io-net | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4062 ms | 4062 ms | — | — | 1 |
| — | deepseek/deepseek-v4-pro warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4102 ms | 4102 ms | 30 tok/s warming | — | 1 |
| — | xiaomi/mimo-v2.5 warming | featherless | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4112 ms | 10435 ms | — | — | 3 |
| — | anthropic/claude-fable-5.1 warming | anthropic | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4287 ms | 5708 ms | — | — | 5 |
| — | deepseek/deepseek-v4-flash warming | digitalocean | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4328 ms | 7482 ms | 9 tok/s warming | — | 2 |
| — | z-ai/glm-5.3-flash warming | arcee | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4421 ms | 16998 ms | — | — | 6 |
| — | z-ai/glm-5.3-flash warming | parasail | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4428 ms | 4428 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4503 ms | 4503 ms | 74 tok/s warming | — | 1 |
| — | nvidia/nemotron-3.5-lightning warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4665 ms | 4665 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | featherless | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4749 ms | 4749 ms | — | — | 1 |
| — | google/gemini-2.5-pro warming | google-vertex | 100.00% | 100.00% | 100.00% 20s | 100.00% | 4840 ms | 4840 ms | — | — | 1 |
| — | thinkingmachines/inkling-small warming | arcee | 100.00% | 100.00% | 100.00% 45s | 100.00% | 4853 ms | 4853 ms | — | — | 1 |
| — | moonshotai/kimi-k3 warming | nvidia-nim | 100.00% | 100.00% | 100.00% 20s | 100.00% | 5120 ms | 6765 ms | 17 tok/s warming | — | 2 |
| — | z-ai/glm-5.2 warming | baseten | 100.00% | 100.00% | 100.00% 45s | 100.00% | 5182 ms | 5182 ms | 47 tok/s warming | — | 1 |
| — | meta-llama/llama-4-scout-17b-16e-instruct warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 5483 ms | 5483 ms | — | — | 1 |
| — | z-ai/glm-5.2 warming | scaleway | 100.00% | 100.00% | 100.00% 45s | 100.00% | 5491 ms | 5491 ms | 31 tok/s warming | — | 1 |
| — | moonshotai/kimi-k3 warming | arcee | 100.00% | 100.00% | 100.00% 20s | 100.00% | 5502 ms | 9374 ms | 34 tok/s warming | — | 5 |
| — | deepseek/deepseek-v4-pro-0423 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 5888 ms | 5888 ms | 34 tok/s warming | — | 1 |
| — | moonshotai/kimi-k3 warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 6106 ms | 6747 ms | 33 tok/s warming | — | 3 |
| — | deepseek/deepseek-v4-flash-vision-exp warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 6116 ms | 6301 ms | — | — | 3 |
| — | qwen/qwen3-coder-480b-a35b-instruct-turbo warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 6191 ms | 19190 ms | — | — | 2 |
| — | z-ai/glm-5.2 warming | featherless | 33.33% | 33.33% | 33.33% 45s | 100.00% | 6577 ms | 6577 ms | — | — | 3 |
| — | z-ai/glm-4.7 warming | zai | 100.00% | 100.00% | 100.00% 20s | 100.00% | 6804 ms | 8062 ms | — | — | 2 |
| — | deepseek/deepseek-v4-flash-0731 warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 6873 ms | 6873 ms | 52 tok/s warming | — | 1 |
| — | deepseek/deepseek-v3.2 warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 7344 ms | 8941 ms | — | — | 2 |
| — | deepseek/deepseek-v4-flash-vision-exp warming | fireworks | 100.00% | 100.00% | 100.00% 20s | 100.00% | 7440 ms | 7440 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | zai | 100.00% | 100.00% | 100.00% 45s | 100.00% | 7683 ms | 8292 ms | — | — | 5 |
| — | qwen/qwen3.5-397b-a17b warming | chutes | 100.00% | 100.00% | 100.00% 20s | 100.00% | 7988 ms | 9590 ms | — | — | 4 |
| — | qwen/qwen3-235b-a22b-instruct-2507 warming | deepinfra | 100.00% | 100.00% | 100.00% 20s | 100.00% | 8534 ms | 8534 ms | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | venice | 100.00% | 100.00% | 100.00% 20s | 100.00% | 9098 ms | 9098 ms | 19 tok/s warming | — | 1 |
| — | z-ai/glm-5-turbo warming | venice | 100.00% | 100.00% | 100.00% 45s | 100.00% | 9299 ms | 9299 ms | — | — | 1 |
| — | z-ai/glm-5.1 warming | chutes | 66.67% | 66.67% | 66.67% 45s | 100.00% | 9327 ms | 30452 ms | — | — | 3 |
| — | meta-llama/llama-3.2-3b warming | venice | 100.00% | 100.00% | 50.00% 20s | 100.00% | 9639 ms | 28959 ms | — | — | 2 |
| — | poolside/laguna-xs-2.1 warming | nvidia-nim | 75.00% | 75.00% | 75.00% 20s | 100.00% | 10057 ms | 11149 ms | — | — | 4 |
| — | z-ai/glm-5.2 warming | chutes | 100.00% | 100.00% | 100.00% 45s | 100.00% | 10142 ms | 20023 ms | 22 tok/s warming | — | 2 |
| — | z-ai/glm-4.5-air warming | io-net | 100.00% | 100.00% | 100.00% 20s | 100.00% | 10996 ms | 10996 ms | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | chutes | 50.00% | 50.00% | 50.00% 20s | 100.00% | 11955 ms | 15509 ms | 26 tok/s warming | — | 4 |
| — | cerebras/qwen-3.8-27b warming | cerebras | 100.00% | 100.00% | 100.00% 15s | 100.00% | 13131 ms | 13131 ms | — | 9 probe_config_error |
17 |
| — | z-ai/glm-5.2 warming | phala | 100.00% | 100.00% | 100.00% 45s | 100.00% | 13268 ms | 13268 ms | 23 tok/s warming | — | 1 |
| — | openai/gpt-oss-120b warming | nebius | 100.00% | 100.00% | 100.00% 20s | 100.00% | 15279 ms | 15279 ms | — | — | 1 |
| — | qwen/qwen3.6-27b warming | siliconflow | 100.00% | 100.00% | 100.00% 20s | 100.00% | 18266 ms | 18266 ms | — | — | 1 |
| — | anthropic/claude-sonnet-5 warming | anthropic | 100.00% | 100.00% | — | 100.00% | — | — | — | — | 6 |
| — | jina-ai/jina-embeddings-v4 warming | jina | 100.00% | 100.00% | — | 100.00% | — | — | — | — | 27 |
| — | minimax/minimax-m3 warming | deepinfra | 100.00% | 100.00% | — | 100.00% | — | — | 19 tok/s warming | — | 18 |
| — | neurometric/tool-choice warming | neurometric | 100.00% | 100.00% | — | 100.00% | — | — | — | — | 500 |
| — | qwen/qwen3.8-27b warming | deepinfra | 100.00% | 100.00% | — | 100.00% | — | — | — | — | 3 |
| — | qwen/qwen3.8-27b warming | telnyx | 100.00% | 100.00% | — | 100.00% | — | — | — | — | 2 |
| — | baichuan/baichuan-m2-32b warming | novita | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | baidu/cobuddy warming | novita | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | — | — | 1 |
| — | deepseek/deepseek-v3.2 warming | venice | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | alibaba | — | — | — | — | — | — | 83 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash warming | deepinfra | — | — | — | — | — | — | 22 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash warming | io-net | — | — | — | — | — | — | 60 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | deepseek/deepseek-v4-flash warming | novita | — | — | — | — | — | — | 75 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash-0731 warming | akashml | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 6 |
| — | deepseek/deepseek-v4-flash-0731 warming | featherless | — | — | — | — | — | — | 71 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash-0731 warming | novita | — | — | — | — | — | — | 131 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-flash-0731 warming | nvidia-nim | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | 7 tok/s warming | — | 2 |
| — | deepseek/deepseek-v4-flash-0731 warming | scaleway | — | — | — | — | — | — | 74 tok/s warming | 2 probe_config_error |
0 |
| — | deepseek/deepseek-v4-flash-0731 warming | wandb | — | — | — | — | — | — | 56 tok/s warming | 3 probe_config_error |
0 |
| — | deepseek/deepseek-v4-pro warming | deepinfra | — | — | — | — | — | — | 36 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-pro warming | novita | — | — | — | — | — | — | 37 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-pro-0423 warming | deepinfra | — | — | — | — | — | — | 95 tok/s warming | — | 0 |
| — | deepseek/deepseek-v4-pro-0423 warming | parasail | 0.00% | 0.00% | 0.00% 20s | 0.00% | — | — | 34 tok/s warming | — | 1 |
| — | deepseek/deepseek-v4-pro-0813 warming | fireworks | — | — | — | — | — | — | 47 tok/s warming | — | 0 |
| — | google/gemini-3.1-pro-preview warming | lightning | — | — | — | — | — | — | 44 tok/s warming | — | 0 |
| — | google/gemma-4-31b-it warming | deepinfra | — | — | — | — | — | — | 9 tok/s warming | — | 0 |
| — | google/gemma-4-31b-it warming | novita | — | — | — | — | — | — | 86 tok/s warming | — | 0 |
| — | google/gemma-4-31b-it warming | nvidia-nim | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 5 |
| — | google/gemma-4-31b-it warming | parasail | — | — | — | — | — | — | 43 tok/s warming | — | 0 |
| — | mindai/macaron-v1-tall warming | novita | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | minimax/minimax-m2.5 warming | inceptron | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 6 |
| — | minimax/minimax-m3 warming | featherless | — | — | — | — | — | — | 118 tok/s warming | 3 probe_config_error |
0 |
| — | minimax/minimax-m3 warming | siliconflow | — | — | — | — | — | — | 73 tok/s warming | — | 0 |
| — | minimax/minimax-m3 warming | wandb | — | — | — | — | — | — | 83 tok/s warming | 2 probe_config_error |
0 |
| — | mistralai/mistral-nemo warming | chutes | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 6 |
| — | mistralai/mistral-nemo warming | novita | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | moonshotai/kimi-k2.6 warming | deepinfra | — | — | — | — | — | — | 15 tok/s warming | — | 0 |
| — | moonshotai/kimi-k2.7-code warming | alibaba | — | — | — | — | — | — | 106 tok/s warming | — | 0 |
| — | moonshotai/kimi-k2.7-code warming | novita | — | — | — | — | — | — | 75 tok/s warming | — | 0 |
| — | moonshotai/kimi-k3 warming | cloudflare-workers-ai | — | — | — | — | — | — | 27 tok/s warming | — | 0 |
| — | moonshotai/kimi-k3 warming | deepinfra | — | — | — | — | — | — | 8 tok/s warming | — | 0 |
| — | moonshotai/kimi-k3 warming | featherless | — | — | — | — | — | — | 16 tok/s warming | 3 probe_config_error |
0 |
| — | moonshotai/kimi-k3 warming | makora | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | 4 probe_config_error |
2 |
| — | moonshotai/kimi-k3 warming | nebius | — | — | — | — | — | — | 86 tok/s warming | — | 0 |
| — | moonshotai/kimi-k3 warming | novita | — | — | — | — | — | — | 15 tok/s warming | — | 0 |
| — | nvidia/nemotron-3.5-lightning-30b-a3b warming | nvidia-nim | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | openai/gpt-oss-120b warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 2 |
| — | qwen/qwen3-235b-a22b-thinking-2507 warming | chutes | 0.00% | 0.00% | 0.00% 45s | 100.00% | — | — | — | — | 4 |
| — | qwen/qwen3-32b warming | chutes | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 2 |
| — | qwen/qwen3-vl-30b-a3b-instruct warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 3 |
| — | qwen/qwen3.5-122b-a10b warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 3 |
| — | qwen/qwen3.6-27b warming | featherless | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | 1 probe_config_error |
1 |
| — | qwen/qwen3.6-27b warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 3 |
| — | qwen/qwen3.6-35b-a3b warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 4 |
| — | qwen/qwen3.8-27b warming | near-ai | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 3 |
| — | xiaomi/mimo-v2.5-pro warming | deepinfra | — | — | — | — | — | — | 29 tok/s warming | — | 0 |
| — | z-ai/glm-4.6 warming | deepinfra | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | z-ai/glm-4.7-flash warming | venice | 0.00% | 0.00% | 0.00% 20s | 100.00% | — | — | — | — | 1 |
| — | z-ai/glm-5.1 warming | near-ai | 0.00% | 0.00% | 0.00% 45s | 100.00% | — | — | — | — | 3 |
| — | z-ai/glm-5.2 warming | alibaba | — | — | — | — | — | — | 53 tok/s warming | — | 0 |
| — | z-ai/glm-5.2 warming | deepinfra | — | — | — | — | — | — | 53 tok/s warming | — | 0 |
| — | z-ai/glm-5.2 warming | venice | — | — | — | — | — | — | 56 tok/s warming | — | 0 |
| — | z-ai/glm-5.3 warming | phala | 0.00% | 0.00% | 0.00% 45s | 100.00% | — | — | — | — | 6 |
| — | z-ai/glm-5.3-flash warming | phala | 0.00% | 0.00% | 0.00% 45s | 100.00% | — | — | — | — | 11 |