OpenAI compatible API. Attested gateway. Public status.

Thinking Machines Inkling 1M Performance

TrustedRouter performance signals and provider route posture for Thinking Machines Inkling 1M.

Verify gateway
1 URLbase_url migration
100smodels and routes
0prompt logs by default

thinkingmachines/inkling-1m

open weights Performance

All models

Measured performance

Continuously sampled p50/p95 time-to-first-token (TTFT), time-to-first-byte (TTFB), throughput, and success rate for Thinking Machines Inkling 1M — unsupported route and probe-configuration rows are separated from provider downtime, and no prompt or output content is stored.

Providerp50 TTFTp95 TTFTp50 TTFBThroughputUptimeConfig excludedSamples
baseten 461 ms 3354 ms 104 tok/s 60.49% 81

Full provider & model leaderboard.

Provider diversity

2 routes.

More routes give the auto router more room to fail over around provider 429 and 5xx responses.

Streaming

Gateway overhead is measured separately.

Public status separates TLS/health overhead from full model latency so slow LLMs do not inflate the router metric.

Status

Metadata rollups.

Status samples store latency, outcome, provider, model, route, cost, and region metadata only.

Sign in

Choose a sign in method.