LLM Provider Latency Benchmarks
Compare measured time-to-first-token, throughput, uptime, and success rates across LLM providers routed continuously through TrustedRouter.
Provider speed data from real routed requests.
TrustedRouter publishes metadata-only measurements for time-to-first-token, throughput, uptime, and excluded probe-configuration rows. The goal is to show what the router actually sees, not what a provider claims in a launch post.
- ✓ Provider and model leaderboards
- ✓ Per-provider performance pages when enough samples exist
- ✓ Per-model performance pages when enough samples exist
- ✓ Prompt and output content never stored for these rollups
{
"provider": "tinfoil",
"model": "moonshotai/kimi-k2.6",
"p50_ttft_ms": 1192,
"uptime": 0.999,
"sample_count": 42
}Provider pages
- Tinfoil performanceConfidential and E2EE route samples
- Anthropic performanceClaude route samples
- Google Vertex performanceManaged Google Cloud route samples
- Google AI Studio performanceGemini Developer API route samples
Model pages
- Kimi K2.6 performanceProvider-specific route metrics
- Gemini Flash performanceFast multimodal route metrics
- GPT Nano performanceSmall-model latency metrics
Current routes, prices, privacy, and measured performance.
Catalog facts come from the routes currently configured in TrustedRouter. Performance uses the same cached metadata snapshot as the public leaderboard. Prompts and outputs are not part of these measurements.
| Model | Providers | Context | Input | Output | Privacy | Measured route |
|---|---|---|---|---|---|---|
Anthropic: Claude Opus 4.8anthropic/claude-opus-4.8 |
|
1,000,000 | $5.275/1M to $5.8025/1M | $26.375/1M to $29.0125/1M | ZDR 5 cited scores | 1816 ms TTFT amazon-bedrock · 80 tok/s · 100.00% available · n=21 |
OpenAI: GPT-5.5openai/gpt-5.5 |
|
1,050,000 | $5.275/1M | $31.65/1M | varies 3 cited scores | No measurements yet |
Google: Gemini 3.5 Flashgoogle/gemini-3.5-flash |
|
1,048,576 | $1.5825/1M | $9.495/1M | varies | 1634 ms TTFT google-vertex · 59 tok/s · 100.00% available · n=3 |
MoonshotAI: Kimi K2.7 Codemoonshotai/kimi-k2.7-code |
+11
|
262,144 | $0.692291/1M to $1.31875/1M | $3.4815/1M to $4.82135/1M | ZDR 5 cited scores | 2482 ms TTFT kimi · 49 tok/s · 100.00% available · n=19 |
Z.ai: GLM 5.2z-ai/glm-5.2 |
+28
|
1,048,576 | $0.3587/1M to $2.361723/1M | $1.5825/1M to $6.819476/1M | Confidential + ZDR 4 cited scores | 2826 ms TTFT arcee · 133 tok/s · 100.00% available · n=75 |
MiniMax: MiniMax M3minimax/minimax-m3 |
+12
|
1,048,576 | $0.24265/1M to $0.633/1M | $1.0128/1M to $2.532/1M | ZDR 4 cited scores | 1371 ms TTFT minimax · 56 tok/s · 100.00% available · n=37 |
Browse every modelReview provider policiesOpen the full leaderboardSnapshot 2026-10-31T08:20:12.540Z
Questions
Are these vendor claims?
No. The leaderboard is generated from TrustedRouter synthetic probes and runtime metadata, not provider marketing claims.
Do latency probes store prompts or outputs?
No. Status and leaderboard records store provider, model, latency, token, route, cost, and outcome metadata only.