OpenAI compatible API · Attested · Public status

DeepInfra performance

Review measured TTFT, effective throughput, uptime, and sampled model routes for DeepInfra on TrustedRouter using metadata-only production probes.

Verify gateway
Onebase URL to migrate
100sof models and routes
0prompt or output logs. Always.

DeepInfradeepinfra

496 samples

Provider overview

Continuously sampled provider performance. TrustedRouter reports unsupported route and probe-configuration rows separately from provider downtime. Prompt and output content is not stored.

p50 TTFT3153 ms
p95 TTFT7121 ms
Effective throughput88 tok/s n=2
Uptime98.99%

Measured model routes

Modelp50 TTFTEffective throughputUptimeConfig excludedAvailability samples
deepseek/deepseek-v4-flash-0731 3153 ms 99.19% 371
z-ai/glm-5.3 3675 ms 96.61% 59
qwen/qwen3.7-max 3762 ms 100.00% 1
qwen/qwen3.5-27b 3995 ms 100.00% 1
nvidia/nemotron-content-safety-3.5 4240 ms 100.00% 1
stepfun-ai/step-3.7-flash 4614 ms 100.00% 1
xiaomi/mimo-v2.5-pro 23 tok/s n=1 100.00% 62
deepseek/deepseek-v4-pro-0423 152 tok/s n=1 0
Workspace access

Sign in

Choose a sign in method to access your TrustedRouter workspace.

By signing in you agree to the terms of service and privacy policy.