Measured performance

Provider & model performance

Measured time-to-first-token, effective throughput, and uptime for every LLM provider and model TrustedRouter routes to — continuously sampled, not vendor-claimed.

Last updated 2026-09-08T11:34:37.359Z

Video leaderboard

Continuously sampled from TrustedRouter's monitor regions using a rolling benchmark set of up to 10,000 samples. Time-to-first-token (TTFT), effective throughput, and success rate come from real streaming requests, not vendor claims. Completion rate shows the end-user result. Provider availability excludes failures owned by TrustedRouter, customers, or route configuration, while still reporting those failures under their actual owner. Capacity acceptance measures requests not rejected for provider overload. Effective throughput is provider-reported output tokens divided by complete request time, so buffered delivery cannot inflate the result. Unsupported route and probe-configuration rows are reported separately and do not count as provider downtime. No prompt or output content is ever stored.

Providers

Ranked by p50 time-to-first-token across all of a provider's models. Provider-attributed availability remains visible and breaks latency ties (56 providers · 3730 availability samples · 205 sustained throughput samples). Providers below the evidence floor remain visible as warming, but do not receive a rank.

#ProviderModels CompletionProvider availabilityWithin deadline Capacity acceptedp50 TTFTp95 TTFT Effective throughputFailure ownerConfig excludedSamples
1 fireworks 18 98.95% 98.95% 90.00% 100.00% 990 ms 7440 ms 57 tok/s provider 3 287
2 together 8 100.00% 100.00% 100.00% 100.00% 995 ms 9692 ms 90 tok/s 31
3 stepfun 3 100.00% 100.00% 100.00% 100.00% 1093 ms 4748 ms 29 tok/s 31
4 grok 6 87.23% 87.23% 85.00% 100.00% 1145 ms 2286 ms 59 tok/s provider 6 47
5 google-ai-studio 9 100.00% 100.00% 100.00% 100.00% 1181 ms 3609 ms 42 tok/s 30
6 google-vertex 10 100.00% 100.00% 100.00% 100.00% 1277 ms 4099 ms 70 tok/s 30
7 parasail 17 93.55% 93.55% 93.55% 93.55% 1308 ms 3061 ms 65 tok/s provider 2 31
8 telnyx 13 97.44% 97.44% 97.30% 100.00% 1389 ms 2856 ms 98 tok/s provider 1 39
9 pearl 3 96.88% 96.88% 96.88% 100.00% 1409 ms 3688 ms 102 tok/s provider 1 32
10 digitalocean 17 97.50% 97.50% 97.50% 100.00% 1411 ms 5121 ms 57 tok/s provider 1 40
11 lightning 15 70.00% 70.00% 70.00% 100.00% 1452 ms 3417 ms 49 tok/s provider 12 40
12 io-net 22 100.00% 100.00% 100.00% 100.00% 1478 ms 4062 ms 60 tok/s 30
13 databricks 7 100.00% 100.00% 100.00% 100.00% 1530 ms 3002 ms 30
14 baseten 11 99.39% 99.39% 99.39% 100.00% 1610 ms 4098 ms 78 tok/s provider 3 493
15 anthropic 11 100.00% 100.00% 100.00% 100.00% 1717 ms 4998 ms 56 tok/s 40
16 akashml 7 82.35% 82.35% 82.35% 100.00% 1808 ms 6805 ms 98 tok/s provider 6 34
17 alibaba 42 100.00% 100.00% 100.00% 100.00% 1820 ms 2883 ms 68 tok/s 44
18 nvidia-nim 12 60.61% 60.61% 60.61% 100.00% 1950 ms 10057 ms 26 tok/s provider 13 33
19 inceptron 6 81.25% 81.25% 81.25% 100.00% 1958 ms 17557 ms 61 tok/s provider 6 32
20 novita 33 87.10% 87.10% 87.10% 96.77% 1995 ms 3044 ms 57 tok/s provider 4 31
21 siliconflow 27 95.74% 95.74% 95.74% 100.00% 2066 ms 6106 ms 54 tok/s provider 2 47
22 openai 20 100.00% 100.00% 100.00% 100.00% 2080 ms 3407 ms 79
23 cerebras 4 99.02% 99.02% 98.46% 100.00% 2091 ms 4605 ms 374 tok/s provider 1 25 probe_config_error 102
24 relace 2 100.00% 100.00% 100.00% 100.00% 2123 ms 5613 ms 77 tok/s 37
25 thinkingmachines 3 100.00% 100.00% 100.00% 100.00% 2123 ms 3873 ms 40 tok/s 33
26 deepseek 5 99.20% 99.20% 98.92% 100.00% 2142 ms 4352 ms provider 4 500
27 deepinfra 35 98.18% 98.18% 97.06% 100.00% 2142 ms 6301 ms 29 tok/s provider 1 55
28 venice 29 91.30% 91.30% 88.64% 97.83% 2143 ms 9639 ms 37 tok/s provider 4 46
29 zero-g 3 100.00% 100.00% 100.00% 100.00% 2202 ms 3872 ms 65 tok/s 40
30 wafer 5 95.12% 95.12% 94.74% 100.00% 2335 ms 7433 ms 54 tok/s provider 2 41
31 azure 8 100.00% 100.00% 100.00% 100.00% 2424 ms 4971 ms 49 tok/s 32
32 perplexity 1 100.00% 100.00% 100.00% 100.00% 2473 ms 5285 ms 31
33 minimax 6 100.00% 100.00% 100.00% 100.00% 2483 ms 10158 ms 52 tok/s 34
34 morph 8 71.79% 71.79% 71.79% 79.49% 2508 ms 5446 ms 38 tok/s provider 11 39
35 tinfoil 7 93.33% 93.33% 93.24% 100.00% 2762 ms 5276 ms 63 tok/s provider 5 75
36 zai 12 98.11% 98.11% 97.78% 100.00% 3168 ms 8292 ms 44 tok/s provider 1 53
37 nebius 13 100.00% 100.00% 100.00% 100.00% 3206 ms 11999 ms 86 tok/s 71
38 arcee 7 100.00% 100.00% 100.00% 100.00% 3784 ms 9374 ms 44 tok/s 32
39 kimi 4 100.00% 100.00% 100.00% 100.00% 4491 ms 5195 ms 37 tok/s 98
friendli warming 7 100.00% 100.00% 100.00% 100.00% 1073 ms 4762 ms 85 tok/s 26
cloudflare-workers-ai warming 14 100.00% 100.00% 100.00% 100.00% 1158 ms 2188 ms 27 tok/s 27
mistral warming 4 100.00% 100.00% 100.00% 100.00% 1193 ms 2354 ms 55 tok/s 29
engy warming 6 100.00% 100.00% 100.00% 100.00% 1248 ms 2608 ms 38 tok/s 21
makora warming 4 75.00% 75.00% 75.00% 100.00% 1304 ms 4849 ms 89 tok/s provider 3 8 probe_config_error 12
scaleway warming 8 100.00% 100.00% 100.00% 100.00% 1339 ms 5491 ms 52 tok/s 2 probe_config_error 19
wandb warming 16 100.00% 100.00% 100.00% 100.00% 1572 ms 2821 ms 70 tok/s 5 probe_config_error 25
phala warming 5 35.71% 35.71% 35.71% 100.00% 2149 ms 13268 ms 25 tok/s provider 18 28
nscale warming 7 100.00% 100.00% 100.00% 100.00% 2182 ms 3797 ms 60 tok/s 26
featherless warming 12 84.21% 84.21% 84.21% 100.00% 2417 ms 10435 ms 118 tok/s provider 3 7 probe_config_error 19
xiaomi warming 3 88.46% 88.46% 88.46% 100.00% 3189 ms 13931 ms 27 tok/s provider 3 26
gmi warming 6 96.55% 96.55% 96.55% 100.00% 3531 ms 5757 ms 38 tok/s provider 1 2 unsupported_route 29
near-ai warming 9 8.00% 8.00% 8.00% 100.00% 3644 ms 5503 ms 28 tok/s provider 23 25
sakana warming 1 70.00% 100.00% 100.00% 100.00% 5775 ms 11996 ms trustedrouter 6 19 probe_config_error 14
chutes warming 8 44.44% 44.44% 44.44% 100.00% 9327 ms 30452 ms 22 tok/s provider 15 27
jina warming 1 100.00% 100.00% 100.00% 27
neurometric warming 1 100.00% 100.00% 100.00% 500

Models

Qualified models are ranked by p50 TTFT, with provider-attributed availability as a tie-breaker. Thin availability and throughput measurements stay visible below the ranked set as warming.

#ModelProvider CompletionProvider availabilityWithin deadlineCapacity accepted p50 TTFTp95 TTFT Effective throughputConfig excludedSamples
1 cerebras/gpt-oss-120b cerebras 90.00% 90.00% 90.00% 15s 100.00% 984 ms 2245 ms 374 tok/s warming 10
2 z-ai/glm-5.3 akashml 100.00% 100.00% 100.00% 45s 100.00% 988 ms 3661 ms 10
3 stepfun/step-3.5-flash-2603 stepfun 100.00% 100.00% 100.00% 20s 100.00% 1013 ms 2631 ms 12
4 x-ai/grok-4.20-reasoning grok 100.00% 100.00% 100.00% 45s 100.00% 1119 ms 12671 ms 10
5 z-ai/glm-5.3-flash wafer 100.00% 100.00% 100.00% 45s 100.00% 1281 ms 12698 ms 10
6 zero-g/0gm-1.0-35b-a3b zero-g 100.00% 100.00% 100.00% 20s 100.00% 1397 ms 3257 ms 12
7 z-ai/glm-5.3 pearl 100.00% 100.00% 100.00% 45s 100.00% 1409 ms 2692 ms 12
8 z-ai/glm-5.3 wafer 100.00% 100.00% 100.00% 45s 100.00% 1454 ms 7433 ms 10
9 x-ai/grok-4.6 grok 66.67% 66.67% 45.45% 20s 100.00% 1455 ms 2211 ms 59 tok/s warming 18
10 deepseek/deepseek-v4-flash-vision-exp deepseek 100.00% 100.00% 100.00% 20s 100.00% 1547 ms 2118 ms 227
11 thinkingmachines/inkling-small thinkingmachines 100.00% 100.00% 100.00% 45s 100.00% 1569 ms 3209 ms 10
12 deepseek/deepseek-v4-flash-0731 baseten 99.37% 99.37% 99.37% 20s 100.00% 1610 ms 4098 ms 102 tok/s warming 476
13 moonshotai/kimi-k2.6 kimi 100.00% 100.00% 100.00% 20s 100.00% 1632 ms 2751 ms 50 tok/s warming 12
14 moonshotai/kimi-k2.7-code-highspeed kimi 100.00% 100.00% 100.00% 20s 100.00% 1691 ms 2841 ms 11
15 minimax/minimax-m2.7 minimax 100.00% 100.00% 100.00% 20s 100.00% 1692 ms 10243 ms 10
16 moonshotai/kimi-k3 relace 100.00% 100.00% 100.00% 20s 100.00% 1725 ms 5613 ms 77 tok/s warming 16
17 openai/gpt-oss-120b databricks 100.00% 100.00% 100.00% 20s 100.00% 1811 ms 3678 ms 11
18 qwen/qwen3.8-27b cerebras 100.00% 100.00% 100.00% 20s 100.00% 2091 ms 4605 ms 16 probe_config_error 68
19 openai/gpt-5.6-luna openai 100.00% 100.00% 100.00% 45s 100.00% 2098 ms 3557 ms 33
20 deepseek/deepseek-v4-flash-0731 relace 100.00% 100.00% 100.00% 20s 100.00% 2123 ms 2982 ms 97 tok/s warming 21
21 z-ai/glm-5.3 thinkingmachines 100.00% 100.00% 100.00% 45s 100.00% 2123 ms 4023 ms 11
22 deepseek/deepseek-v4-flash-0731 deepseek 98.40% 98.40% 96.72% 20s 100.00% 2142 ms 5685 ms 250
23 qwen/qwen2.5-coder-3b-instruct nscale 100.00% 100.00% 100.00% 20s 100.00% 2182 ms 2448 ms 10
24 zero-g/0gm-1.0-35b-a3b-sia zero-g 100.00% 100.00% 100.00% 20s 100.00% 2202 ms 4034 ms 13
25 perplexity/sonar perplexity 100.00% 100.00% 100.00% 20s 100.00% 2473 ms 5285 ms 31
26 stepfun/step-3.7-flash stepfun 100.00% 100.00% 100.00% 20s 100.00% 2485 ms 5706 ms 29 tok/s warming 14
27 deepseek/deepseek-v4-flash deepseek 100.00% 100.00% 100.00% 20s 100.00% 2551 ms 4767 ms 13
28 deepseek/deepseek-v4-flash tinfoil 88.64% 88.64% 88.64% 20s 100.00% 2762 ms 6707 ms 58 tok/s warming 44
29 z-ai/glm-5.3 zero-g 100.00% 100.00% 100.00% 45s 100.00% 2893 ms 3910 ms 65 tok/s warming 15
30 thinkingmachines/inkling thinkingmachines 100.00% 100.00% 100.00% 45s 100.00% 2967 ms 3873 ms 40 tok/s warming 12
31 z-ai/glm-5.3-flash pearl 91.67% 91.67% 91.67% 45s 100.00% 3128 ms 3755 ms 12
32 z-ai/glm-5.3-flash zai 100.00% 100.00% 100.00% 45s 100.00% 3147 ms 7240 ms 11
33 xiaomi/mimo-v2.5 xiaomi 90.91% 90.91% 90.91% 20s 100.00% 3189 ms 13931 ms 11
34 deepseek/deepseek-v4-flash-0731 nebius 100.00% 100.00% 100.00% 20s 100.00% 3206 ms 8590 ms 77 tok/s warming 52
35 moonshotai/kimi-k3 kimi 100.00% 100.00% 100.00% 20s 100.00% 4491 ms 5761 ms 23 tok/s warming 71
36 sakana-ai/fugu-ultra-v1.1 sakana 70.00% 100.00% 100.00% 20s 100.00% 5775 ms 11996 ms 19 probe_config_error 14
37 xiaomi/mimo-v2.5-pro xiaomi 84.62% 84.62% 84.62% 20s 100.00% 6289 ms 18461 ms 27 tok/s warming 13
38 z-ai/glm-5.3 zai 92.31% 92.31% 91.67% 45s 100.00% 7084 ms 9545 ms 13
qwen/qwen3.5-27b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 387 ms 2246 ms 2
qwen/qwen3-vl-30b-a3b-instruct warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 455 ms 455 ms 1
z-ai/glm-5.2 warming friendli 100.00% 100.00% 100.00% 45s 100.00% 547 ms 1794 ms 85 tok/s warming 2
google/gemini-2.5-flash-lite warming google-vertex 100.00% 100.00% 100.00% 15s 100.00% 567 ms 567 ms 2
google/gemini-3.5-flash-lite warming google-ai-studio 100.00% 100.00% 100.00% 15s 100.00% 654 ms 1211 ms 2
google/gemma-4-31b-it warming tinfoil 100.00% 100.00% 100.00% 20s 100.00% 685 ms 1489 ms 67 tok/s warming 4
nvidia/nemotron-3-nano-30b-a3b warming novita 100.00% 100.00% 100.00% 20s 100.00% 691 ms 691 ms 1
z-ai/glm-5.2 warming parasail 100.00% 100.00% 100.00% 45s 100.00% 693 ms 793 ms 87 tok/s warming 2
deepseek/deepseek-v4-flash-0731 warming pearl 100.00% 100.00% 100.00% 20s 100.00% 707 ms 2393 ms 102 tok/s warming 8
thinkingmachines/inkling warming deepinfra 100.00% 100.00% 100.00% 45s 100.00% 707 ms 1371 ms 2
nvidia/nemotron-nano-12b-v2-vl warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 719 ms 773 ms 2
openai/gpt-oss-120b warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 730 ms 730 ms 1
z-ai/glm-5.2 warming io-net 100.00% 100.00% 100.00% 45s 100.00% 743 ms 2505 ms 70 tok/s warming 2
mistralai/ministral-3-14b-instruct warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 751 ms 751 ms 1
openai/gpt-4.1 warming openai 100.00% 100.00% 100.00% 20s 100.00% 762 ms 3090 ms 2
openai/gpt-oss-20b warming io-net 100.00% 100.00% 100.00% 20s 100.00% 763 ms 763 ms 1
qwen/qwen3.8-2.4t-a95b warming together 100.00% 100.00% 100.00% 20s 100.00% 776 ms 776 ms 1
openpipe/qwen3-14b-instruct warming wandb 100.00% 100.00% 100.00% 20s 100.00% 781 ms 781 ms 1
nvidia/nemotron-3.5-lightning warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 809 ms 2115 ms 2
google/gemini-3.1-flash-lite warming google-ai-studio 100.00% 100.00% 100.00% 15s 100.00% 816 ms 2419 ms 4
google/gemini-2.5-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 832 ms 1386 ms 2
z-ai/glm-5.3 warming telnyx 100.00% 100.00% 100.00% 45s 100.00% 832 ms 832 ms 1
qwen/qwen3.6-27b warming io-net 100.00% 100.00% 100.00% 20s 100.00% 837 ms 3322 ms 2
openai/gpt-5.4-mini warming openai 100.00% 100.00% 100.00% 20s 100.00% 849 ms 963 ms 2
z-ai/glm-5.3-flash warming baseten 100.00% 100.00% 100.00% 45s 100.00% 863 ms 863 ms 1
z-ai/glm-4.7-flash warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 873 ms 873 ms 1
google/gemini-3.6-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 874 ms 1412 ms 69 tok/s warming 2
openai/gpt-oss-120b warming cerebras 100.00% 100.00% 100.00% 20s 100.00% 881 ms 1984 ms 7
meta-models/muse-glimmer-30b warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 886 ms 886 ms 1
meta-llama/llama-3.1-70b-instruct warming wandb 100.00% 100.00% 100.00% 20s 100.00% 897 ms 1464 ms 3
lightning-ai/deepseek-v4-pro warming lightning 100.00% 100.00% 100.00% 20s 100.00% 903 ms 1577 ms 2
morph/morph-v3-fast warming morph 40.00% 40.00% 40.00% 15s 100.00% 906 ms 2236 ms 5
z-ai/glm-5.2 warming engy 100.00% 100.00% 100.00% 45s 100.00% 909 ms 1018 ms 32 tok/s warming 2
Qwen/Qwen3-235B-A22B-Instruct-2507 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 910 ms 13340 ms 2
lightning-ai/gpt-oss-120b warming lightning 15.38% 15.38% 15.38% 20s 100.00% 915 ms 915 ms 13
x-ai/grok-build-0.1 warming grok 100.00% 100.00% 100.00% 20s 100.00% 919 ms 1106 ms 2
x-ai/grok-4.5 warming grok 100.00% 100.00% 100.00% 20s 100.00% 920 ms 2267 ms 6
openai/gpt-oss-20b warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 921 ms 1245 ms 2
z-ai/glm-5.2 warming together 100.00% 100.00% 100.00% 45s 100.00% 932 ms 1673 ms 135 tok/s warming 2
stepfun-ai/step-3.7-flash warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 935 ms 935 ms 1
google/gemma-4-26b-a4b-it warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 938 ms 2135 ms 2
z-ai/glm-5.3-flash warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 944 ms 944 ms 1
NousResearch/Hermes-4-405B warming nebius 100.00% 100.00% 100.00% 20s 100.00% 954 ms 3429 ms 2
cohere/command-a warming azure 100.00% 100.00% 100.00% 20s 100.00% 955 ms 2216 ms 2
deepseek/deepseek-v4-pro warming parasail 100.00% 100.00% 100.00% 20s 100.00% 969 ms 1228 ms 2
inclusionai/ling-3.0-flash-fin warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 973 ms 2257 ms 2
moonshotai/kimi-k2.7-code warming io-net 100.00% 100.00% 100.00% 20s 100.00% 973 ms 1038 ms 75 tok/s warming 2
openai/gpt-4.1-mini warming openai 100.00% 100.00% 100.00% 20s 100.00% 983 ms 2357 ms 3
z-ai/glm-5.3-fast warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 985 ms 1082 ms 3
deepseek/deepseek-v4-flash warming featherless 100.00% 100.00% 100.00% 20s 100.00% 988 ms 3222 ms 141 tok/s warming 2
z-ai/glm-5.2-fast warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 990 ms 990 ms 134 tok/s warming 255
minimax/minimax-m3 warming parasail 66.67% 66.67% 66.67% 20s 66.67% 992 ms 3061 ms 96 tok/s warming 3
minimax/minimax-m3 warming together 100.00% 100.00% 100.00% 20s 100.00% 995 ms 995 ms 90 tok/s warming 16
meta-llama/llama-3.2-3b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 996 ms 1018 ms 2
moonshotai/kimi-k2.6 warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1001 ms 1636 ms 57 tok/s warming 2
thedrummer/skyfall-36b-v2 warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1002 ms 2578 ms 2
meta-llama/llama-3.2-1b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1004 ms 1440 ms 2
minimax/minimax-m3-preview warming venice 100.00% 100.00% 100.00% 20s 100.00% 1016 ms 3232 ms 2
z-ai/glm-5.3-flash warming friendli 100.00% 100.00% 100.00% 45s 100.00% 1019 ms 2030 ms 4
openai/gpt-oss-20b warming together 100.00% 100.00% 100.00% 20s 100.00% 1020 ms 1020 ms 1
qwen/qwen3.5-122b-a10b warming novita 100.00% 100.00% 100.00% 20s 100.00% 1026 ms 1026 ms 1
nvidia/nemotron-3-ultra-550b-a55b warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 1029 ms 1246 ms 2
qwen/qwen3-vl-235b-a22b warming venice 100.00% 100.00% 100.00% 20s 100.00% 1029 ms 1114 ms 2
anthropic/claude-haiku-4.5 warming anthropic 100.00% 100.00% 100.00% 15s 100.00% 1030 ms 1515 ms 4
nvidia/nemotron-3-super-120b warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1035 ms 1935 ms 2
z-ai/glm-5.1 warming friendli 100.00% 100.00% 100.00% 45s 100.00% 1044 ms 9396 ms 3
openai/gpt-5.1 warming openai 100.00% 100.00% 100.00% 20s 100.00% 1056 ms 1171 ms 2
openai/gpt-oss-120b warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1066 ms 1699 ms 3
gryphe/mythomax-l2-13b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1067 ms 1503 ms 2
openai/gpt-oss-120b warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1067 ms 1951 ms 2
google/gemma-4-31b-it warming friendli 100.00% 100.00% 100.00% 20s 100.00% 1073 ms 1550 ms 131 tok/s warming 4
openai/gpt-5.6-sol warming openai 100.00% 100.00% 100.00% 45s 100.00% 1074 ms 1529 ms 2
moonshotai/kimi-k3 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1075 ms 1075 ms 32 tok/s warming 1
qwen/qwen3-6-35b-a3b warming venice 100.00% 100.00% 100.00% 20s 100.00% 1083 ms 1352 ms 2
google/gemma-4-31b-it warming lightning 50.00% 50.00% 50.00% 20s 100.00% 1087 ms 1087 ms 175 tok/s warming 2
stepfun/step-3.5-flash warming stepfun 100.00% 100.00% 100.00% 20s 100.00% 1093 ms 2351 ms 5
deepseek/deepseek-v4-flash warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1098 ms 2634 ms 2
deepseek/deepseek-v4-flash warming makora 100.00% 100.00% 100.00% 20s 100.00% 1100 ms 1100 ms 89 tok/s warming 3 probe_config_error 1
mistralai/codestral-2508 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1100 ms 2354 ms 7
openai/gpt-4-0613 warming openai 100.00% 100.00% 100.00% 20s 100.00% 1102 ms 2113 ms 2
deepseek/deepseek-v4-flash-vision-exp warming novita 100.00% 100.00% 100.00% 20s 100.00% 1113 ms 1113 ms 1
deepseek/deepseek-v4-flash-vision-exp warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1127 ms 1127 ms 1
mistralai/mistral-nemo warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1133 ms 1869 ms 7
qwen/qwen3-235b-a22b-thinking-2507 warming venice 100.00% 100.00% 100.00% 45s 100.00% 1143 ms 1143 ms 1
x-ai/grok-4.3 warming grok 100.00% 100.00% 100.00% 20s 100.00% 1145 ms 2009 ms 6
qwen/qwen2.5-coder-32b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1153 ms 1153 ms 1
meta-llama/llama-3.1-8b-instruct-fp8 warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1158 ms 1337 ms 2
meta-llama/llama-3.1-8b-instruct warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1160 ms 2166 ms 2
google/gemini-3-flash-preview warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1169 ms 1184 ms 5
deepseek/deepseek-v4-flash warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1174 ms 2418 ms 16 tok/s warming 2
mistralai/mistral-medium-3.5-128b warming scaleway 100.00% 100.00% 100.00% 20s 100.00% 1175 ms 1961 ms 2
deepseek/deepseek-v4-pro warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1177 ms 1277 ms 2
google/gemini-3.6-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1181 ms 2900 ms 5
qwen/qwen3-next-80b-a3b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 1188 ms 1188 ms 1
mistralai/mistral-small-2603 warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1193 ms 2520 ms 9
x-ai/grok-4.20-non-reasoning warming azure 100.00% 100.00% 100.00% 45s 100.00% 1201 ms 2580 ms 2
ibm-granite/granite-4.0-h-micro warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1202 ms 1953 ms 4
qwen/qwen3.6-35b-a3b warming engy 100.00% 100.00% 100.00% 20s 100.00% 1203 ms 1441 ms 2
google/gemini-3.5-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 1208 ms 1715 ms 83 tok/s warming 4
moonshotai/kimi-k2.6 warming azure 100.00% 100.00% 100.00% 20s 100.00% 1210 ms 1804 ms 146 tok/s warming 3
meta-llama/llama-3.1-8b-instruct warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1212 ms 1212 ms 1
meta-llama/llama-3.1-8b-instruct warming databricks 100.00% 100.00% 100.00% 20s 100.00% 1215 ms 2231 ms 4
minimax/minimax-m3 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1224 ms 1575 ms 114 tok/s warming 3
moonshotai/kimi-k2.6 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1231 ms 2147 ms 167 tok/s warming 3
z-ai/glm-5.3-flash warming telnyx 100.00% 100.00% 100.00% 45s 100.00% 1234 ms 2583 ms 4
deepseek/deepseek-v4-flash-0731 warming engy 100.00% 100.00% 100.00% 20s 100.00% 1237 ms 2920 ms 45 tok/s warming 4
nvidia/nemotron-3-ultra-550b warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1239 ms 1435 ms 2
qwen/qwen3.7-max-2026-05-20 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1240 ms 1240 ms 1
z-ai/glm-5.3-flash warming engy 100.00% 100.00% 100.00% 45s 100.00% 1248 ms 2272 ms 5
meta-llama/llama-3.3-70b-instruct-fp8-fast warming cloudflare-workers-ai 100.00% 100.00% 100.00% 15s 100.00% 1250 ms 1250 ms 1
google/gemma-3-12b-it warming databricks 100.00% 100.00% 100.00% 20s 100.00% 1253 ms 2941 ms 4
moonshotai/kimi-k2.7-code warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 1253 ms 2750 ms 48 tok/s warming 3
deepseek/deepseek-v3.2 warming friendli 100.00% 100.00% 100.00% 20s 100.00% 1258 ms 4762 ms 5
mistralai/mistral-large warming mistral 100.00% 100.00% 100.00% 20s 100.00% 1260 ms 2322 ms 55 tok/s warming 6
mistralai/pixtral-12b-2409 warming scaleway 100.00% 100.00% 100.00% 20s 100.00% 1265 ms 1525 ms 3
qwen/qwen3-vl-235b-a22b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1269 ms 1354 ms 2
qwen/qwen3-vl-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1270 ms 1270 ms 1
openai/gpt-4o warming openai 100.00% 100.00% 100.00% 20s 100.00% 1271 ms 1271 ms 1
z-ai/glm-5 warming digitalocean 100.00% 100.00% 100.00% 45s 100.00% 1271 ms 2438 ms 4
jetbrains/mellum2-12b-a2.5b-instruct warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1276 ms 1662 ms 2
google/gemini-3.5-flash-lite warming google-vertex 100.00% 100.00% 100.00% 15s 100.00% 1277 ms 2238 ms 5
mistralai/mistral-small-3.2-24b-instruct-2506 warming scaleway 100.00% 100.00% 100.00% 20s 100.00% 1277 ms 1294 ms 2
meta-llama/llama-3.3-70b-instruct warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1281 ms 1281 ms 1
meta-llama/llama-3.3-70b-instruct warming akashml 100.00% 100.00% 100.00% 20s 100.00% 1282 ms 1756 ms 2
qwen/qwen3-5-35b-a3b warming venice 100.00% 100.00% 100.00% 20s 100.00% 1287 ms 2424 ms 2
nvidia/nemotron-3_5-lightning warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1288 ms 2020 ms 2
x-ai/grok-4.20 warming grok 100.00% 100.00% 100.00% 20s 100.00% 1293 ms 2286 ms 5
qwen/qwen3-vl-235b-a22b-instruct warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1302 ms 1302 ms 1
qwen/qwen3-30b-a3b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1303 ms 1303 ms 1
deepseek/deepseek-v4-pro warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1304 ms 1304 ms 1
z-ai/glm-5.3 warming makora 75.00% 75.00% 75.00% 45s 100.00% 1304 ms 2703 ms 4
qwen/qwen2.5-vl-72b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1308 ms 2753 ms 2
openai/gpt-oss-120b warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1316 ms 1316 ms 1
qwen/qwen3.6-flash-2026-04-16 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1320 ms 2215 ms 2
moonshotai/kimi-k2.7-code warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1326 ms 2280 ms 78 tok/s warming 5
z-ai/glm-5.1 warming digitalocean 100.00% 100.00% 100.00% 45s 100.00% 1330 ms 2482 ms 2
deepseek/deepseek-v4-flash-0731 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1331 ms 3723 ms 56 tok/s warming 2
moonshotai/kimi-k2.6 warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1333 ms 1616 ms 3
deepseek/deepseek-v3.1 warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1335 ms 1335 ms 1
qwen/qwen3-vl-flash-2025-10-15 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1338 ms 1338 ms 1
qwen/qwen3-235b-a22b-instruct-2507 warming scaleway 100.00% 100.00% 100.00% 20s 100.00% 1339 ms 1438 ms 3
deepseek/deepseek-v4-flash-0731 warming inceptron 100.00% 100.00% 100.00% 20s 100.00% 1344 ms 1958 ms 70 tok/s warming 4
qwen/qwen3.6-plus warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1348 ms 1348 ms 1
arcee-ai/trinity-large-thinking warming arcee 100.00% 100.00% 100.00% 45s 100.00% 1350 ms 2903 ms 4
lightning-ai/nemotron-3-ultra-550b-a55b warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1350 ms 1585 ms 2
moonshotai/kimi-k2-thinking warming io-net 100.00% 100.00% 100.00% 45s 100.00% 1353 ms 1353 ms 1
meta-llama/llama-3.3-70b-instruct warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1358 ms 2992 ms 6
meta-llama/llama-3.3-70b-instruct warming scaleway 100.00% 100.00% 100.00% 20s 100.00% 1359 ms 1716 ms 3
openai/gpt-oss-20b warming nscale 100.00% 100.00% 100.00% 20s 100.00% 1365 ms 2077 ms 2
moonshotai/kimi-k3 warming engy 100.00% 100.00% 100.00% 20s 100.00% 1370 ms 2507 ms 55 tok/s warming 4
anthropic/claude-sonnet-4.6 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 1371 ms 4568 ms 4
moonshotai/kimi-k2.6 warming inceptron 100.00% 100.00% 100.00% 20s 100.00% 1371 ms 1940 ms 3
google/gemini-3.5-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1375 ms 2489 ms 4
anthropic/claude-opus-4.8 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 1380 ms 3040 ms 87 tok/s warming 5
qwen/qwen3.5-35b-a3b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1385 ms 1918 ms 2
meta-llama/llama-4-maverick-17b-128e-instruct-fp8 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1388 ms 1388 ms 1
google/gemma-2b-it warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1389 ms 2190 ms 4
minimax/minimax-m3 warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 1391 ms 1391 ms 105 tok/s warming 1
moonshotai/Kimi-K2.7-Code warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1395 ms 1395 ms 1
mistralai/mistral-small-3.1-24b-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1396 ms 2060 ms 3
qwen/qwen3.8-max warming fireworks 57.14% 57.14% 25.00% 20s 100.00% 1407 ms 1407 ms 7
meta-llama/llama-3.2-11b-vision-instruct warming nvidia-nim 100.00% 100.00% 100.00% 20s 100.00% 1409 ms 2095 ms 2
qwen/qwen3.5-397b-a17b warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1411 ms 1415 ms 3
qwen/qwen3.5-27b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1413 ms 1413 ms 1
moonshotai/kimi-k2.7-code warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1417 ms 1417 ms 1
meta-llama/llama-3.3-70b-instruct warming together 100.00% 100.00% 100.00% 20s 100.00% 1423 ms 1925 ms 3
bytedance/seed-2.0-code warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1426 ms 1426 ms 1
nvidia/nemotron-3-nano-omni-30b-a3b-reasoning warming nvidia-nim 100.00% 100.00% 100.00% 45s 100.00% 1428 ms 2094 ms 3
openai/gpt-oss-120b warming novita 100.00% 100.00% 100.00% 20s 100.00% 1431 ms 1431 ms 1
inclusionai/ling-3.0-flash warming novita 100.00% 100.00% 100.00% 20s 100.00% 1441 ms 1441 ms 1
qwen/qwen-mt-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1445 ms 1445 ms 1
deepseek/deepseek-v4-pro warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1452 ms 1452 ms 133 tok/s warming 1
openai/gpt-3.5-turbo warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1452 ms 1452 ms 1
minimax/minimax-m2.7-highspeed warming minimax 100.00% 100.00% 100.00% 20s 100.00% 1464 ms 3413 ms 4
qwen/qwen3-coder-30b-a3b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1472 ms 1472 ms 1
meta-llama/llama-3.3-70b-instruct warming databricks 100.00% 100.00% 100.00% 20s 100.00% 1473 ms 2464 ms 4
nvidia/nemotron-3-ultra-550b-a55b warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1477 ms 2029 ms 2
moonshotai/kimi-k2-instruct-0905 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1478 ms 4009 ms 5
meta-llama/llama-4-maverick warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1490 ms 2762 ms 4
z-ai/glm-5.2 warming telnyx 100.00% 100.00% 100.00% 45s 100.00% 1497 ms 1824 ms 70 tok/s warming 3
thinkingmachines/inkling warming together 100.00% 100.00% 100.00% 45s 100.00% 1500 ms 2704 ms 5
qwen/qwen3-next-80b warming venice 100.00% 100.00% 100.00% 20s 100.00% 1507 ms 1507 ms 1
z-ai/glm-5.1 warming telnyx 100.00% 100.00% 100.00% 45s 100.00% 1519 ms 1519 ms 1
meta-llama/llama-4-scout-17b-16e-instruct warming cloudflare-workers-ai 100.00% 100.00% 100.00% 20s 100.00% 1523 ms 2190 ms 4
openai/gpt-oss-20b warming databricks 100.00% 100.00% 100.00% 20s 100.00% 1530 ms 1587 ms 4
nvidia/nemotron-3-ultra-550b-a55b warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1531 ms 1531 ms 1
qwen/qwen3-vl-plus warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1533 ms 1533 ms 1
google/gemini-3-flash-preview warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 1535 ms 2367 ms 6
zai-org/glm-4.6 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1537 ms 3022 ms 2
qwen/qwen3.5-27b warming novita 100.00% 100.00% 100.00% 20s 100.00% 1539 ms 1539 ms 1
x-ai/grok-4.1-fast-non-reasoning warming azure 100.00% 100.00% 100.00% 45s 100.00% 1543 ms 3217 ms 3
qwen/qwen3-235b-a22b-instruct-2507 warming nscale 100.00% 100.00% 100.00% 20s 100.00% 1545 ms 1704 ms 3
prism-ml/ternary-bonsai-27b warming together 100.00% 100.00% 100.00% 20s 100.00% 1548 ms 9692 ms 2
minimax/minimax-m3 warming nvidia-nim 100.00% 100.00% 100.00% 20s 100.00% 1561 ms 1561 ms 35 tok/s warming 1
nvidia/nemotron-3-nano-30b-a3b-bf16 warming nscale 100.00% 100.00% 100.00% 20s 100.00% 1561 ms 1561 ms 1
anthropic/claude-opus-5 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 1565 ms 3896 ms 56 tok/s warming 2
moonshotai/kimi-k2.7-code warming kimi 100.00% 100.00% 100.00% 20s 100.00% 1570 ms 2553 ms 55 tok/s warming 4
deepseek/deepseek-v4-flash warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1572 ms 2388 ms 45 tok/s warming 3
moonshotai/kimi-k2.7-code warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1575 ms 1575 ms 1
deepseek/deepseek-v4-pro-0423 warming venice 100.00% 100.00% 100.00% 20s 100.00% 1582 ms 3329 ms 32 tok/s warming 2
thedrummer/cydonia-24b-v4.1 warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1584 ms 1584 ms 1
meta-llama/llama-3.3-70b-instruct warming tinfoil 100.00% 100.00% 100.00% 20s 100.00% 1609 ms 3044 ms 2
nvidia/nemotron-3-super-120b-a12b warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1611 ms 1611 ms 1
z-ai/glm-4.7 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1620 ms 1620 ms 1
z-ai/glm-5.2 warming morph 100.00% 100.00% 100.00% 45s 100.00% 1620 ms 2278 ms 41 tok/s warming 5
lightning-ai/qwen3.8-27b warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1626 ms 1998 ms 3
z-ai/glm-4.7-flash warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1631 ms 1631 ms 1
google/gemma-4-26b-a4b-it warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1646 ms 1646 ms 1
qwen/qwen3-vl-32b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1648 ms 1648 ms 1
qwen/qwen3-next-80b-a3b-instruct warming databricks 100.00% 100.00% 100.00% 20s 100.00% 1649 ms 2635 ms 2
minimax/minimax-m2.5 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1650 ms 3294 ms 2
z-ai/glm-4.6 warming zai 100.00% 100.00% 100.00% 20s 100.00% 1650 ms 1650 ms 1
openai/gpt-oss-120b warming tinfoil 100.00% 100.00% 100.00% 20s 100.00% 1653 ms 3842 ms 6
moonshotai/kimi-k3-fast-api warming venice 100.00% 100.00% 100.00% 15s 100.00% 1661 ms 1661 ms 1
moonshotai/kimi-k2.6 warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1667 ms 2821 ms 4
openai/gpt-5 warming openai 100.00% 100.00% 100.00% 20s 100.00% 1667 ms 1667 ms 1
qwen/qwen3-next-80b-a3b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 1667 ms 3005 ms 4
openai/gpt-oss-120b warming nscale 100.00% 100.00% 100.00% 20s 100.00% 1668 ms 1668 ms 60 tok/s warming 1
zai-org/GLM-5.2 warming nebius 100.00% 100.00% 100.00% 45s 100.00% 1672 ms 1672 ms 1
qwen/qwen3-30b-a3b-thinking-2507 warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 1681 ms 1681 ms 1
qwen/qwen3.6-35b-a3b warming siliconflow 66.67% 66.67% 66.67% 20s 100.00% 1683 ms 2125 ms 3
z-ai/glm-5.3 warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 1684 ms 1684 ms 1
openai/gpt-4-turbo warming openai 100.00% 100.00% 100.00% 20s 100.00% 1687 ms 1687 ms 1
openai/gpt-oss-120b-ultra warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1695 ms 1695 ms 1
qwen/qwen-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1703 ms 1703 ms 1
moonshotai/kimi-k2.6 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 1709 ms 2856 ms 2
google/gemini-3.1-flash-image-preview warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1710 ms 3409 ms 2
openai/gpt-5-nano warming openai 100.00% 100.00% 100.00% 20s 100.00% 1711 ms 4048 ms 20
moonshotai/kimi-k3 warming venice 50.00% 50.00% 50.00% 20s 100.00% 1711 ms 4169 ms 37 tok/s warming 4
qwen/qwen3-235b-a22b-instruct-2507 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1712 ms 2257 ms 2
anthropic/claude-opus-4.7 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 1717 ms 2253 ms 5
openai/o3-mini warming openai 100.00% 100.00% 100.00% 45s 100.00% 1718 ms 1718 ms 1
qwen/qwen3-coder-480b-a35b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1725 ms 1725 ms 1
xiaomi/mimo-v2.5 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1738 ms 1738 ms 1
qwen/qwen3.5-397b-a17b warming venice 100.00% 100.00% 100.00% 20s 100.00% 1741 ms 1741 ms 1
deepseek/deepseek-v3.1 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1747 ms 1747 ms 1
z-ai/glm-5.3 warming tinfoil 100.00% 100.00% 100.00% 45s 100.00% 1753 ms 4831 ms 8
openai/gpt-oss-120b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1764 ms 1764 ms 1
deepseek/deepseek-v4-flash-0731 warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 1770 ms 1770 ms 109 tok/s warming 1
z-ai/glm-5.2 warming wandb 100.00% 100.00% 100.00% 45s 100.00% 1786 ms 1786 ms 143 tok/s warming 1
z-ai/glm-5 warming gmi 80.00% 80.00% 80.00% 45s 100.00% 1790 ms 4861 ms 5
qwen/qwen3-vl-235b-a22b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1802 ms 1802 ms 1
z-ai/glm-5.3-flash warming nebius 100.00% 100.00% 100.00% 45s 100.00% 1802 ms 40643 ms 4
anthropic/claude-sonnet-4.5 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 1803 ms 1803 ms 1
deepseek/deepseek-v4-pro-0813 warming baseten 100.00% 100.00% 100.00% 20s 100.00% 1808 ms 1928 ms 49 tok/s warming 2
openai/gpt-oss-120b warming akashml 100.00% 100.00% 100.00% 20s 100.00% 1808 ms 6805 ms 5
openai/gpt-4 warming lightning 100.00% 100.00% 100.00% 20s 100.00% 1813 ms 1919 ms 2
z-ai/glm-5.3 warming friendli 100.00% 100.00% 100.00% 45s 100.00% 1815 ms 2702 ms 3
nvidia/nemotron-3-ultra-550b-a55b warming nvidia-nim 50.00% 50.00% 50.00% 20s 100.00% 1815 ms 1815 ms 2
moonshotai/kimi-k2.5 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1820 ms 1820 ms 1
meta-llama/llama-4-maverick warming databricks 100.00% 100.00% 100.00% 20s 100.00% 1823 ms 1823 ms 1
x-ai/grok-4.1-fast-reasoning warming azure 100.00% 100.00% 100.00% 45s 100.00% 1823 ms 2998 ms 4
ibm-granite/granite-4.1-8b warming wandb 100.00% 100.00% 100.00% 20s 100.00% 1829 ms 8793 ms 3
moonshotai/kimi-k2.5 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1832 ms 1832 ms 1
qwen/qwen3.5-flash warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1842 ms 1842 ms 1
google/gemma-4-12b-it warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1843 ms 1843 ms 1
meta-llama/llama-4-maverick-17b-128e-instruct-fp8 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1843 ms 1843 ms 1
mistralai/mistral-nemo-instruct-2407 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1845 ms 1845 ms 1
google/gemini-3.8-flash warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 1871 ms 2644 ms 3
deepseek/deepseek-v4-flash-0731 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1874 ms 1874 ms 52 tok/s warming 1
qwen/qwen-flash-2025-07-28 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1880 ms 1880 ms 1
tencent/hunyuan-a13b-instruct warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1883 ms 1883 ms 1
moonshotai/kimi-k2.5 warming nscale 100.00% 100.00% 100.00% 20s 100.00% 1905 ms 3782 ms 5
z-ai/glm-5.2 warming novita 100.00% 100.00% 100.00% 45s 100.00% 1905 ms 1905 ms 56 tok/s warming 1
moonshotai/kimi-k3 warming together 100.00% 100.00% 100.00% 20s 100.00% 1909 ms 1909 ms 35 tok/s warming 1
qwen/qwen3-max-preview warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1913 ms 1913 ms 1
qwen/qwen3-vl-32b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 1922 ms 1922 ms 1
openai/gpt-6-astra warming openai 100.00% 100.00% 100.00% 20s 100.00% 1929 ms 1929 ms 1
tencent/hy3 warming novita 100.00% 100.00% 100.00% 20s 100.00% 1931 ms 2357 ms 2
z-ai/glm-5.3 warming engy 100.00% 100.00% 100.00% 45s 100.00% 1932 ms 2608 ms 4
deepseek/deepseek-v4-pro warming gmi 100.00% 100.00% 100.00% 20s 100.00% 1935 ms 4537 ms 3
nvidia/nemotron-3-super-120b-a12b warming nvidia-nim 100.00% 100.00% 100.00% 20s 100.00% 1942 ms 2083 ms 3
morph/morph-v3-large warming morph 100.00% 100.00% 100.00% 20s 100.00% 1944 ms 2064 ms 3
moonshotai/Kimi-K2.6 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1950 ms 2274 ms 2
openai/gpt-oss-20b warming nvidia-nim 100.00% 100.00% 100.00% 20s 100.00% 1950 ms 3942 ms 4
google/gemini-3.1-flash-lite warming google-vertex 100.00% 100.00% 100.00% 15s 100.00% 1955 ms 1955 ms 1
google/gemma-4-31b-it-turbo warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 1955 ms 1955 ms 1
qwen/qwen3.5-9b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 1957 ms 2639 ms 3
moonshotai/kimi-k2-6 warming venice 100.00% 100.00% 100.00% 20s 100.00% 1958 ms 4245 ms 2
moonshotai/kimi-k2.7-code warming inceptron 100.00% 100.00% 100.00% 20s 100.00% 1958 ms 17557 ms 8
z-ai/glm-5.3-flash warming featherless 100.00% 100.00% 100.00% 45s 100.00% 1960 ms 6035 ms 2
qwen/qwen-mt-plus warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 1961 ms 2000 ms 2
deepseek-ai/DeepSeek-V4-Pro warming nebius 100.00% 100.00% 100.00% 20s 100.00% 1962 ms 2595 ms 2
moonshotai/kimi-k2.6 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1962 ms 1962 ms 50 tok/s warming 1
minimax/minimax-m2.5 warming friendli 100.00% 100.00% 100.00% 20s 100.00% 1970 ms 2299 ms 5
qwen/qwen3-next-80b-a3b-instruct warming io-net 100.00% 100.00% 100.00% 20s 100.00% 1976 ms 1976 ms 1
google/gemini-2.5-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 1980 ms 2302 ms 2
z-ai/glm-5.2 warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 1980 ms 2198 ms 129 tok/s warming 3
google/gemma-4-31b-it warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 1984 ms 1984 ms 68 tok/s warming 1
openai/gpt-5.5 warming openai 100.00% 100.00% 100.00% 45s 100.00% 1987 ms 1987 ms 1
qwen/qwen3.5-397b-a17b warming novita 100.00% 100.00% 100.00% 20s 100.00% 1995 ms 2730 ms 2
qwen/qwen3-vl-8b-instruct warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2007 ms 2007 ms 1
deepseek/deepseek-v3.2 warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2011 ms 4577 ms 4
moonshotai/kimi-k3 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 2012 ms 2012 ms 21 tok/s warming 1
openai/gpt-oss-20b warming novita 100.00% 100.00% 100.00% 20s 100.00% 2027 ms 2027 ms 1
lightning-ai/gpt-oss-20b warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2029 ms 2563 ms 3
anthropic/claude-opus-4.6 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 2032 ms 2032 ms 1
qwen/qwen3.7-flash-2026-07-15 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2039 ms 2039 ms 1
z-ai/glm-5.3 warming inceptron 100.00% 100.00% 100.00% 45s 100.00% 2051 ms 2656 ms 3
z-ai/glm-5v-turbo warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 2066 ms 2800 ms 3
openai/gpt-4.1 warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2067 ms 2842 ms 3
z-ai/glm-4.5-air warming zai 100.00% 100.00% 100.00% 20s 100.00% 2068 ms 2914 ms 3
moonshotai/kimi-k2.5 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 2075 ms 2535 ms 3
qwen/qwen3-235b-a22b-thinking-2507 warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 2079 ms 2079 ms 1
openai/gpt-3.5-turbo-1106 warming openai 100.00% 100.00% 100.00% 20s 100.00% 2080 ms 2080 ms 1
z-ai/glm-4.5v warming zai 100.00% 100.00% 100.00% 20s 100.00% 2085 ms 4149 ms 4
minimax/minimax-m2.5 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2107 ms 3143 ms 2
anthropic/claude-opus-4.5 warming anthropic 100.00% 100.00% 100.00% 45s 100.00% 2118 ms 2270 ms 3
openai/gpt-4o warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2122 ms 2813 ms 3
deepseek/deepseek-v3.1 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2128 ms 2128 ms 1
z-ai/glm-5v-turbo warming venice 100.00% 100.00% 100.00% 45s 100.00% 2133 ms 2133 ms 1
bytedance/ui-tars-1.5-7b warming parasail 100.00% 100.00% 100.00% 20s 100.00% 2138 ms 2773 ms 2
qwen/qwen3.5-35b-a3b warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2142 ms 2142 ms 1
qwen/qwen3-235b-a22b-instruct-2507 warming venice 100.00% 100.00% 100.00% 20s 100.00% 2143 ms 2143 ms 1
moonshotai/kimi-k3 warming phala 100.00% 100.00% 100.00% 20s 100.00% 2149 ms 11722 ms 27 tok/s warming 7
xiaomi/mimo-v2.5-pro-ultraspeed warming xiaomi 100.00% 100.00% 100.00% 20s 100.00% 2152 ms 2800 ms 2
openai/gpt-oss-120b warming scaleway 100.00% 100.00% 100.00% 20s 100.00% 2163 ms 2766 ms 5
google/gemini-2.5-flash warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2170 ms 2170 ms 1
google/gemini-2.5-flash-lite-preview-06-17 warming lightning 100.00% 100.00% 100.00% 15s 100.00% 2170 ms 2170 ms 1
deepseek/deepseek-r1-distill-qwen-32b warming cloudflare-workers-ai 100.00% 100.00% 100.00% 45s 100.00% 2188 ms 2188 ms 1
deepseek/deepseek-v4-flash-0731-fast warming venice 100.00% 100.00% 100.00% 15s 100.00% 2196 ms 2196 ms 3
minimax/minimax-m2.5 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 2197 ms 3455 ms 2
zai-org/glm-5 warming novita 100.00% 100.00% 100.00% 45s 100.00% 2207 ms 2207 ms 1
qwen/qwen3-max-2025-09-23 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2209 ms 2209 ms 1
qwen/qwen3-30b-a3b-instruct-2507 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2213 ms 2213 ms 1
qwen/qwen3.6-35b-a3b warming akashml 100.00% 100.00% 100.00% 20s 100.00% 2215 ms 3672 ms 2
microsoft/phi-4 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2229 ms 2229 ms 1
qwen/qwen3-235b-a22b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2230 ms 2230 ms 1
qwen/qwen3-vl-8b-instruct warming parasail 100.00% 100.00% 100.00% 20s 100.00% 2239 ms 2261 ms 2
qwen/qwen3-vl-8b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 2239 ms 2239 ms 1
z-ai/glm-5.3 warming featherless 100.00% 100.00% 100.00% 45s 100.00% 2244 ms 3069 ms 3
openai/gpt-5.2 warming openai 100.00% 100.00% 100.00% 20s 100.00% 2247 ms 2247 ms 1
qwen/qwen3-32b warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2263 ms 2263 ms 2
z-ai/glm-5.1 warming gmi 100.00% 100.00% 100.00% 45s 100.00% 2268 ms 4996 ms 2
moonshotai/kimi-k2.5 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2275 ms 2275 ms 1
qwen/qwen2.5-coder-32b-instruct warming nscale 100.00% 100.00% 100.00% 20s 100.00% 2276 ms 3797 ms 4
qwen/qwen3-vl-235b-a22b-thinking warming alibaba 100.00% 100.00% 100.00% 45s 100.00% 2300 ms 2300 ms 1
minimax/minimax-m3 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2305 ms 2305 ms 57 tok/s warming 1
xiaomi/mimo-v2.5-pro warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2333 ms 5121 ms 42 tok/s warming 2
moonshotai/kimi-k3 warming wafer 88.89% 88.89% 88.89% 20s 100.00% 2335 ms 3911 ms 54 tok/s warming 9
moonshotai/kimi-k2.5 warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2356 ms 2582 ms 3
tencent/hy3 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2361 ms 3328 ms 3
deepseek/deepseek-v4-flash-0731-fast warming wafer 85.71% 85.71% 85.71% 15s 100.00% 2370 ms 2829 ms 7
minimax/minimax-m2.5 warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 2376 ms 2857 ms 2
deepseek/deepseek-v3.2 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2398 ms 2398 ms 1
moonshotai/kimi-k2.5 warming io-net 100.00% 100.00% 100.00% 20s 100.00% 2398 ms 2398 ms 1
z-ai/glm-5.1 warming featherless 100.00% 100.00% 100.00% 45s 100.00% 2417 ms 2660 ms 2
moonshotai/kimi-k2.7-code warming azure 100.00% 100.00% 100.00% 20s 100.00% 2424 ms 17230 ms 49 tok/s warming 9
google/gemma-3-27b-it warming novita 100.00% 100.00% 100.00% 20s 100.00% 2425 ms 2425 ms 1
mistralai/mistral-nemotron warming nvidia-nim 25.00% 25.00% 25.00% 20s 100.00% 2434 ms 2434 ms 4
openai/gpt-4-turbo warming lightning 100.00% 100.00% 100.00% 20s 100.00% 2438 ms 2988 ms 2
openai/gpt-5-mini warming openai 100.00% 100.00% 100.00% 20s 100.00% 2461 ms 2461 ms 1
z-ai/glm-5v-turbo warming zai 100.00% 100.00% 100.00% 45s 100.00% 2466 ms 2467 ms 2
z-ai/glm-5.2 warming akashml 100.00% 100.00% 100.00% 45s 100.00% 2476 ms 4777 ms 98 tok/s warming 4
moonshotai/kimi-k3 warming telnyx 85.71% 85.71% 85.71% 20s 100.00% 2477 ms 2668 ms 103 tok/s warming 7
google/gemma-4-31b-it warming siliconflow 50.00% 50.00% 50.00% 20s 100.00% 2482 ms 2482 ms 34 tok/s warming 2
minimax/minimax-m2.5-highspeed warming minimax 100.00% 100.00% 100.00% 20s 100.00% 2483 ms 2776 ms 3
moonshotai/kimi-k3-fast warming fireworks 100.00% 100.00% 100.00% 15s 100.00% 2485 ms 2485 ms 1
google/gemma-4-31b-it warming wandb 100.00% 100.00% 100.00% 20s 100.00% 2489 ms 2601 ms 42 tok/s warming 2
minimax/minimax-m2 warming novita 100.00% 100.00% 100.00% 20s 100.00% 2506 ms 2506 ms 1
deepseek/deepseek-v4-flash warming morph 100.00% 100.00% 100.00% 20s 100.00% 2508 ms 4219 ms 28 tok/s warming 8
qwen/qwen3.5-397b-a17b warming morph 80.00% 80.00% 80.00% 20s 80.00% 2508 ms 3943 ms 5
openai/gpt-oss-120b warming parasail 100.00% 100.00% 100.00% 20s 100.00% 2519 ms 2519 ms 1
minimax/minimax-m2.7 warming morph 66.67% 66.67% 66.67% 20s 66.67% 2519 ms 8462 ms 3
meta-llama/llama-4-scout-17b-16e-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 2523 ms 2523 ms 1
nvidia/nemotron-3.5-lightning-30b-a3b warming wandb 100.00% 100.00% 100.00% 20s 100.00% 2587 ms 2587 ms 1
openai/o4-mini warming openai 100.00% 100.00% 100.00% 45s 100.00% 2602 ms 2693 ms 2
qwen/qwen-vl-ocr-2025-11-20 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2603 ms 2603 ms 1
anthropic/claude-fable-5 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 2607 ms 3405 ms 4
z-ai/glm-5.3 warming parasail 100.00% 100.00% 100.00% 45s 100.00% 2617 ms 2617 ms 1
z-ai/glm-5.1 warming phala 66.67% 66.67% 66.67% 45s 100.00% 2617 ms 3521 ms 3
z-ai/glm-4.6v warming zai 100.00% 100.00% 100.00% 20s 100.00% 2623 ms 3364 ms 3
openai/gpt-oss-120b-turbo warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2645 ms 2645 ms 1
qwen/qwen-vl-ocr warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2646 ms 2646 ms 1
minimax/minimax-m2.1-highspeed warming minimax 100.00% 100.00% 100.00% 20s 100.00% 2652 ms 3069 ms 5
deepseek/deepseek-v4-flash-0731 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 2663 ms 2663 ms 86 tok/s warming 1
z-ai/glm-4.7 warming venice 100.00% 100.00% 100.00% 20s 100.00% 2665 ms 2665 ms 3
deepseek/deepseek-v4-pro-0813 warming deepseek 100.00% 100.00% 100.00% 20s 100.00% 2666 ms 6468 ms 5
minimax/minimax-m2 warming minimax 100.00% 100.00% 100.00% 20s 100.00% 2675 ms 4500 ms 5
x-ai/grok-4.20-reasoning warming azure 100.00% 100.00% 100.00% 45s 100.00% 2705 ms 3906 ms 6
z-ai/glm-5.2 warming digitalocean 50.00% 50.00% 50.00% 45s 100.00% 2706 ms 2706 ms 63 tok/s warming 2
qwen/qwen-3-7-max warming venice 100.00% 100.00% 100.00% 20s 100.00% 2736 ms 2736 ms 1
minimax/minimax-m27 warming venice 100.00% 100.00% 100.00% 20s 100.00% 2738 ms 2738 ms 1
z-ai/glm-4.5 warming zai 100.00% 100.00% 100.00% 20s 100.00% 2743 ms 6447 ms 2
moonshotai/kimi-k3 warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 2747 ms 8100 ms 44 tok/s warming 3
MiniMaxAI/MiniMax-M3 warming nebius 100.00% 100.00% 100.00% 20s 100.00% 2757 ms 2757 ms 1
qwen/qwen3-next-80b-a3b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 2758 ms 2758 ms 1
z-ai/glm-5.2 warming fireworks 100.00% 100.00% 100.00% 45s 100.00% 2761 ms 2832 ms 57 tok/s warming 3
z-ai/glm-5 warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 2766 ms 5687 ms 2
openai/gpt-oss-20b warming akashml 100.00% 100.00% 100.00% 20s 100.00% 2779 ms 12205 ms 5
deepseek/deepseek-v4-flash-0731 warming telnyx 100.00% 100.00% 100.00% 20s 100.00% 2788 ms 2788 ms 93 tok/s warming 1
deepseek/deepseek-v4-pro warming arcee 100.00% 100.00% 100.00% 20s 100.00% 2790 ms 3437 ms 4
qwen/qwen3-coder-30b-a3b-instruct warming novita 100.00% 100.00% 100.00% 20s 100.00% 2821 ms 2821 ms 1
google/gemini-3.8-flash warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 2840 ms 3332 ms 3
qwen/qwen3-max warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 2875 ms 2875 ms 1
qwen/qwen3.7-max warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2883 ms 2883 ms 1
z-ai/glm-5.2 warming inceptron 100.00% 100.00% 100.00% 45s 100.00% 2887 ms 24152 ms 51 tok/s warming 8
qwen/qwen-plus-2025-07-28 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 2925 ms 2925 ms 1
moonshotai/kimi-k2.7-code warming featherless 100.00% 100.00% 100.00% 20s 100.00% 2960 ms 3489 ms 2
deepseek/deepseek-v4-pro warming venice 100.00% 100.00% 100.00% 20s 100.00% 2981 ms 5234 ms 26 tok/s warming 2
moonshotai/kimi-k2.6 warming wafer 100.00% 100.00% 100.00% 20s 100.00% 3021 ms 3339 ms 49 tok/s warming 5
google/gemini-3.5-flash warming lightning 100.00% 100.00% 100.00% 20s 100.00% 3024 ms 3024 ms 55 tok/s warming 1
qwen/qwen3.6-27b warming novita 100.00% 100.00% 100.00% 20s 100.00% 3044 ms 3044 ms 1
moonshotai/kimi-k2-7-code warming venice 100.00% 100.00% 100.00% 20s 100.00% 3071 ms 3071 ms 1
minimax/minimax-m3 warming minimax 100.00% 100.00% 100.00% 20s 100.00% 3100 ms 10158 ms 52 tok/s warming 7
deepseek/deepseek-r1-0528 warming io-net 100.00% 100.00% 100.00% 45s 100.00% 3102 ms 3102 ms 1
qwen/qwen3.6-27b warming morph 28.57% 28.57% 28.57% 20s 28.57% 3126 ms 5086 ms 7
tencent/hy4-preview warming gmi 100.00% 100.00% 100.00% 20s 100.00% 3140 ms 4434 ms 2 unsupported_route 3
openai/o3 warming openai 100.00% 100.00% 100.00% 45s 100.00% 3155 ms 3155 ms 1
openai/gpt-oss-20b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3156 ms 3156 ms 1
deepseek/deepseek-v4-flash warming arcee 100.00% 100.00% 100.00% 20s 100.00% 3157 ms 4010 ms 54 tok/s warming 6
openai/gpt-5.6-terra warming openai 100.00% 100.00% 100.00% 45s 100.00% 3162 ms 3162 ms 1
z-ai/glm-5.2 warming zai 100.00% 100.00% 100.00% 45s 100.00% 3168 ms 4332 ms 44 tok/s warming 4
qwen/qwen3.6-plus-2026-04-02 warming alibaba 100.00% 100.00% 100.00% 20s 100.00% 3186 ms 3186 ms 1
google/gemini-3.1-pro-preview warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 3204 ms 4099 ms 70 tok/s warming 4
qwen/qwen3.5-122b-a10b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3223 ms 3223 ms 1
minimax/minimax-m3 warming morph 66.67% 66.67% 66.67% 20s 66.67% 3293 ms 5446 ms 35 tok/s warming 3
z-ai/glm-5.1 warming siliconflow 100.00% 100.00% 100.00% 45s 100.00% 3308 ms 3308 ms 1
z-ai/glm-5.2-fast warming baseten 100.00% 100.00% 100.00% 45s 100.00% 3314 ms 3314 ms 78 tok/s warming 2
z-ai/glm-4.5-air warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3317 ms 3467 ms 2
moonshotai/kimi-k2.5 warming azure 100.00% 100.00% 100.00% 20s 100.00% 3320 ms 4971 ms 3
z-ai/glm-5.3-flash warming tinfoil 100.00% 100.00% 100.00% 45s 100.00% 3328 ms 4314 ms 8
google/gemini-2.5-pro warming lightning 100.00% 100.00% 100.00% 20s 100.00% 3417 ms 4111 ms 2
z-ai/glm-5 warming zai 100.00% 100.00% 100.00% 45s 100.00% 3466 ms 4230 ms 3
deepseek/deepseek-v3.2-exp warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 3518 ms 3518 ms 1
moonshotai/kimi-k3 warming gmi 100.00% 100.00% 100.00% 20s 100.00% 3531 ms 5757 ms 42 tok/s warming 9
deepseek/deepseek-v4-flash-0731 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 3534 ms 4907 ms 43 tok/s warming 4
deepseek/deepseek-v3 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 3563 ms 3563 ms 1
z-ai/glm-5.2 warming gmi 100.00% 100.00% 100.00% 45s 100.00% 3600 ms 5876 ms 33 tok/s warming 7
google/gemini-3.1-pro-preview warming google-ai-studio 100.00% 100.00% 100.00% 20s 100.00% 3609 ms 5747 ms 42 tok/s warming 3
z-ai/glm-5.2 warming near-ai 66.67% 66.67% 66.67% 45s 100.00% 3644 ms 5503 ms 28 tok/s warming 3
z-ai/glm-5.3-flash warming makora 100.00% 100.00% 100.00% 45s 100.00% 3657 ms 4849 ms 1 unsupported_route 5
z-ai/glm-5.2 warming tinfoil 100.00% 100.00% 100.00% 45s 100.00% 3720 ms 3776 ms 3
z-ai/glm-5.2 warming arcee 100.00% 100.00% 100.00% 45s 100.00% 3784 ms 5182 ms 6
z-ai/glm-4.6 warming venice 100.00% 100.00% 100.00% 20s 100.00% 3800 ms 9122 ms 3
qwen/qwen-3-8-2-4t-a95b warming venice 100.00% 100.00% 100.00% 20s 100.00% 3857 ms 3857 ms 1
deepseek/deepseek-v4-pro warming deepseek 100.00% 100.00% 100.00% 20s 100.00% 3878 ms 4413 ms 5
z-ai/glm-5.1 warming io-net 100.00% 100.00% 100.00% 45s 100.00% 4062 ms 4062 ms 1
deepseek/deepseek-v4-pro warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 4102 ms 4102 ms 30 tok/s warming 1
xiaomi/mimo-v2.5 warming featherless 100.00% 100.00% 100.00% 20s 100.00% 4112 ms 10435 ms 3
anthropic/claude-fable-5.1 warming anthropic 100.00% 100.00% 100.00% 20s 100.00% 4287 ms 5708 ms 5
deepseek/deepseek-v4-flash warming digitalocean 100.00% 100.00% 100.00% 20s 100.00% 4328 ms 7482 ms 9 tok/s warming 2
z-ai/glm-5.3-flash warming arcee 100.00% 100.00% 100.00% 45s 100.00% 4421 ms 16998 ms 6
z-ai/glm-5.3-flash warming parasail 100.00% 100.00% 100.00% 45s 100.00% 4428 ms 4428 ms 1
moonshotai/kimi-k2.6 warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 4503 ms 4503 ms 74 tok/s warming 1
nvidia/nemotron-3.5-lightning warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 4665 ms 4665 ms 1
moonshotai/kimi-k2.6 warming featherless 100.00% 100.00% 100.00% 20s 100.00% 4749 ms 4749 ms 1
google/gemini-2.5-pro warming google-vertex 100.00% 100.00% 100.00% 20s 100.00% 4840 ms 4840 ms 1
thinkingmachines/inkling-small warming arcee 100.00% 100.00% 100.00% 45s 100.00% 4853 ms 4853 ms 1
moonshotai/kimi-k3 warming nvidia-nim 100.00% 100.00% 100.00% 20s 100.00% 5120 ms 6765 ms 17 tok/s warming 2
z-ai/glm-5.2 warming baseten 100.00% 100.00% 100.00% 45s 100.00% 5182 ms 5182 ms 47 tok/s warming 1
meta-llama/llama-4-scout-17b-16e-instruct warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 5483 ms 5483 ms 1
z-ai/glm-5.2 warming scaleway 100.00% 100.00% 100.00% 45s 100.00% 5491 ms 5491 ms 31 tok/s warming 1
moonshotai/kimi-k3 warming arcee 100.00% 100.00% 100.00% 20s 100.00% 5502 ms 9374 ms 34 tok/s warming 5
deepseek/deepseek-v4-pro-0423 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 5888 ms 5888 ms 34 tok/s warming 1
moonshotai/kimi-k3 warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 6106 ms 6747 ms 33 tok/s warming 3
deepseek/deepseek-v4-flash-vision-exp warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 6116 ms 6301 ms 3
qwen/qwen3-coder-480b-a35b-instruct-turbo warming venice 100.00% 100.00% 100.00% 20s 100.00% 6191 ms 19190 ms 2
z-ai/glm-5.2 warming featherless 33.33% 33.33% 33.33% 45s 100.00% 6577 ms 6577 ms 3
z-ai/glm-4.7 warming zai 100.00% 100.00% 100.00% 20s 100.00% 6804 ms 8062 ms 2
deepseek/deepseek-v4-flash-0731 warming venice 100.00% 100.00% 100.00% 20s 100.00% 6873 ms 6873 ms 52 tok/s warming 1
deepseek/deepseek-v3.2 warming chutes 100.00% 100.00% 100.00% 20s 100.00% 7344 ms 8941 ms 2
deepseek/deepseek-v4-flash-vision-exp warming fireworks 100.00% 100.00% 100.00% 20s 100.00% 7440 ms 7440 ms 1
z-ai/glm-5.1 warming zai 100.00% 100.00% 100.00% 45s 100.00% 7683 ms 8292 ms 5
qwen/qwen3.5-397b-a17b warming chutes 100.00% 100.00% 100.00% 20s 100.00% 7988 ms 9590 ms 4
qwen/qwen3-235b-a22b-instruct-2507 warming deepinfra 100.00% 100.00% 100.00% 20s 100.00% 8534 ms 8534 ms 1
deepseek/deepseek-v4-flash warming venice 100.00% 100.00% 100.00% 20s 100.00% 9098 ms 9098 ms 19 tok/s warming 1
z-ai/glm-5-turbo warming venice 100.00% 100.00% 100.00% 45s 100.00% 9299 ms 9299 ms 1
z-ai/glm-5.1 warming chutes 66.67% 66.67% 66.67% 45s 100.00% 9327 ms 30452 ms 3
meta-llama/llama-3.2-3b warming venice 100.00% 100.00% 50.00% 20s 100.00% 9639 ms 28959 ms 2
poolside/laguna-xs-2.1 warming nvidia-nim 75.00% 75.00% 75.00% 20s 100.00% 10057 ms 11149 ms 4
z-ai/glm-5.2 warming chutes 100.00% 100.00% 100.00% 45s 100.00% 10142 ms 20023 ms 22 tok/s warming 2
z-ai/glm-4.5-air warming io-net 100.00% 100.00% 100.00% 20s 100.00% 10996 ms 10996 ms 1
moonshotai/kimi-k2.6 warming chutes 50.00% 50.00% 50.00% 20s 100.00% 11955 ms 15509 ms 26 tok/s warming 4
cerebras/qwen-3.8-27b warming cerebras 100.00% 100.00% 100.00% 15s 100.00% 13131 ms 13131 ms 9 probe_config_error 17
z-ai/glm-5.2 warming phala 100.00% 100.00% 100.00% 45s 100.00% 13268 ms 13268 ms 23 tok/s warming 1
openai/gpt-oss-120b warming nebius 100.00% 100.00% 100.00% 20s 100.00% 15279 ms 15279 ms 1
qwen/qwen3.6-27b warming siliconflow 100.00% 100.00% 100.00% 20s 100.00% 18266 ms 18266 ms 1
anthropic/claude-sonnet-5 warming anthropic 100.00% 100.00% 100.00% 6
jina-ai/jina-embeddings-v4 warming jina 100.00% 100.00% 100.00% 27
minimax/minimax-m3 warming deepinfra 100.00% 100.00% 100.00% 19 tok/s warming 18
neurometric/tool-choice warming neurometric 100.00% 100.00% 100.00% 500
qwen/qwen3.8-27b warming deepinfra 100.00% 100.00% 100.00% 3
qwen/qwen3.8-27b warming telnyx 100.00% 100.00% 100.00% 2
baichuan/baichuan-m2-32b warming novita 0.00% 0.00% 0.00% 20s 100.00% 1
baidu/cobuddy warming novita 0.00% 0.00% 0.00% 20s 0.00% 1
deepseek/deepseek-v3.2 warming venice 0.00% 0.00% 0.00% 20s 0.00% 1
deepseek/deepseek-v4-flash warming alibaba 83 tok/s warming 0
deepseek/deepseek-v4-flash warming deepinfra 22 tok/s warming 0
deepseek/deepseek-v4-flash warming io-net 60 tok/s warming 0
deepseek/deepseek-v4-flash warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 1
deepseek/deepseek-v4-flash warming novita 75 tok/s warming 0
deepseek/deepseek-v4-flash-0731 warming akashml 0.00% 0.00% 0.00% 20s 100.00% 6
deepseek/deepseek-v4-flash-0731 warming featherless 71 tok/s warming 0
deepseek/deepseek-v4-flash-0731 warming novita 131 tok/s warming 0
deepseek/deepseek-v4-flash-0731 warming nvidia-nim 0.00% 0.00% 0.00% 20s 100.00% 7 tok/s warming 2
deepseek/deepseek-v4-flash-0731 warming scaleway 74 tok/s warming 2 probe_config_error 0
deepseek/deepseek-v4-flash-0731 warming wandb 56 tok/s warming 3 probe_config_error 0
deepseek/deepseek-v4-pro warming deepinfra 36 tok/s warming 0
deepseek/deepseek-v4-pro warming novita 37 tok/s warming 0
deepseek/deepseek-v4-pro-0423 warming deepinfra 95 tok/s warming 0
deepseek/deepseek-v4-pro-0423 warming parasail 0.00% 0.00% 0.00% 20s 0.00% 34 tok/s warming 1
deepseek/deepseek-v4-pro-0813 warming fireworks 47 tok/s warming 0
google/gemini-3.1-pro-preview warming lightning 44 tok/s warming 0
google/gemma-4-31b-it warming deepinfra 9 tok/s warming 0
google/gemma-4-31b-it warming novita 86 tok/s warming 0
google/gemma-4-31b-it warming nvidia-nim 0.00% 0.00% 0.00% 20s 100.00% 5
google/gemma-4-31b-it warming parasail 43 tok/s warming 0
mindai/macaron-v1-tall warming novita 0.00% 0.00% 0.00% 20s 100.00% 1
minimax/minimax-m2.5 warming inceptron 0.00% 0.00% 0.00% 20s 100.00% 6
minimax/minimax-m3 warming featherless 118 tok/s warming 3 probe_config_error 0
minimax/minimax-m3 warming siliconflow 73 tok/s warming 0
minimax/minimax-m3 warming wandb 83 tok/s warming 2 probe_config_error 0
mistralai/mistral-nemo warming chutes 0.00% 0.00% 0.00% 20s 100.00% 6
mistralai/mistral-nemo warming novita 0.00% 0.00% 0.00% 20s 100.00% 1
moonshotai/kimi-k2.6 warming deepinfra 15 tok/s warming 0
moonshotai/kimi-k2.7-code warming alibaba 106 tok/s warming 0
moonshotai/kimi-k2.7-code warming novita 75 tok/s warming 0
moonshotai/kimi-k3 warming cloudflare-workers-ai 27 tok/s warming 0
moonshotai/kimi-k3 warming deepinfra 8 tok/s warming 0
moonshotai/kimi-k3 warming featherless 16 tok/s warming 3 probe_config_error 0
moonshotai/kimi-k3 warming makora 0.00% 0.00% 0.00% 20s 100.00% 4 probe_config_error 2
moonshotai/kimi-k3 warming nebius 86 tok/s warming 0
moonshotai/kimi-k3 warming novita 15 tok/s warming 0
nvidia/nemotron-3.5-lightning-30b-a3b warming nvidia-nim 0.00% 0.00% 0.00% 20s 100.00% 1
openai/gpt-oss-120b warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 2
qwen/qwen3-235b-a22b-thinking-2507 warming chutes 0.00% 0.00% 0.00% 45s 100.00% 4
qwen/qwen3-32b warming chutes 0.00% 0.00% 0.00% 20s 100.00% 2
qwen/qwen3-vl-30b-a3b-instruct warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 3
qwen/qwen3.5-122b-a10b warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 3
qwen/qwen3.6-27b warming featherless 0.00% 0.00% 0.00% 20s 100.00% 1 probe_config_error 1
qwen/qwen3.6-27b warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 3
qwen/qwen3.6-35b-a3b warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 4
qwen/qwen3.8-27b warming near-ai 0.00% 0.00% 0.00% 20s 100.00% 3
xiaomi/mimo-v2.5-pro warming deepinfra 29 tok/s warming 0
z-ai/glm-4.6 warming deepinfra 0.00% 0.00% 0.00% 20s 100.00% 1
z-ai/glm-4.7-flash warming venice 0.00% 0.00% 0.00% 20s 100.00% 1
z-ai/glm-5.1 warming near-ai 0.00% 0.00% 0.00% 45s 100.00% 3
z-ai/glm-5.2 warming alibaba 53 tok/s warming 0
z-ai/glm-5.2 warming deepinfra 53 tok/s warming 0
z-ai/glm-5.2 warming venice 56 tok/s warming 0
z-ai/glm-5.3 warming phala 0.00% 0.00% 0.00% 45s 100.00% 6
z-ai/glm-5.3-flash warming phala 0.00% 0.00% 0.00% 45s 100.00% 11
Workspace access

Sign in

Choose a sign in method to access your TrustedRouter workspace.

By signing in you agree to the terms of service and privacy policy.