OpenAI compatible API. Attested gateway. Public status.
Lightning AI performance
Measured TTFT, TTFB, throughput, uptime, and sampled model routes for Lightning AI.
1 URLbase_url migration
100smodels and routes
0prompt logs by default
lightning
320 samples
Continuously sampled provider performance. TrustedRouter reports unsupported route and probe-configuration rows separately from provider downtime. Prompt and output content is not stored.
| p50 TTFT | 759 ms |
|---|---|
| p95 TTFT | ms |
| p50 TTFB | ms |
| Throughput | — |
| Uptime | 100.00% |
Measured model routes
| Model | p50 TTFT | p50 TTFB | Throughput | Uptime | Config excluded | Samples |
|---|---|---|---|---|---|---|
| google/gemma-4-31b-it | 759 ms | 674 ms | — | 100.00% | — | 320 |