AWS Bedrock Alternative — Attested Confidential LLM API
Hitting Bedrock throttling and quota limits? TrustedRouter routes Claude and 220+ models through a hardware-attested TEE gateway you can verify live.
Keep the privacy you chose Bedrock for, without the quota wall.
Teams pick Amazon Bedrock for the data story: inference stays inside your AWS account, HIPAA-eligible under an AWS BAA. Then production traffic arrives. Default quotas on popular Claude models can throttle to a few requests per minute, output tokens draw down quota faster than input, and new models land on AWS's schedule. The workload that cleared the compliance review is now waiting on 429s.
TrustedRouter is an OpenAI-compatible API in front of 220+ model routes across 30+ providers: Claude, plus GPT, Gemini, DeepSeek, Kimi, Qwen, and GLM. When a provider is down, the gateway rolls traffic over automatically. The prompt path runs inside a hardware-attested confidential-compute gateway whose source is open and whose image digest is published, so you can verify what code touches your prompts.
from openai import OpenAI
client = OpenAI(
base_url="https://api.trustedrouter.com/v1",
api_key=TR_API_KEY,
)
resp = client.chat.completions.create(
model="trustedrouter/auto",
messages=[{"role": "user",
"content": "Classify this claims document."}],
)Route around the quota wall
One key fronts 220+ routes with automatic rollover when a provider is down. Meta-routes decide per request: trustedrouter/auto for best fit, trustedrouter/fast for latency, trustedrouter/cheap for the cheapest capable route in a TEE. A document-processing company scaled from zero to over a billion tokens per week through the attested gateway within three weeks of onboarding. Measured latency from real routed requests: benchmarks.
Attestation beats a privacy policy
Bedrock's privacy case rests on the AWS account boundary. TrustedRouter's rests on hardware: curl the attestation endpoint with a nonce and get back a JWT signed by the CPU vendor's root key, bound to your live TLS session, with an image digest that matches the published artifact. TrustedRouter never logs prompt or output content. Ordinary synchronous and streaming inference does not retain it. The opt-in Batch API temporarily retains enclave-encrypted artifacts for up to 30 days. Details at security and confidential computing.
Documentation your auditors can assess
TrustedRouter does not claim SOC 2 or HIPAA certification. It offers verifiable architecture plus readiness documentation your compliance team can assess: SOC 2 readiness, HIPAA readiness, a DPA, a BAA, and a subprocessor list. Per-route tiers add Zero-Data-Retention or full TEE isolation. Healthcare workloads: HIPAA LLM API.
Change the base URL. Keep everything else.
Point your existing OpenAI SDK at https://api.trustedrouter.com/v1 and keep your code, model ids, and tooling. Per-model pricing is published at pricing: a thin markup over provider list prices. Pay with prepaid credits, bring your own provider keys, or sign in with MetaMask and pay per request with x402. An EU gateway with EU-focused routing is at /eu; the smart-cheap-fast chooser is at choose.
Two things Bedrock does that TrustedRouter does not: private network paths through VPC and PrivateLink, and spend that draws down an AWS EDP commitment. If those anchor your architecture, Bedrock keeps that advantage. If you need high-volume inference with a privacy story your own team can verify from the outside, run the attestation check before you send a single prompt. Privacy you can check beats privacy you're promised.
Current routes, prices, privacy, and measured performance.
Catalog facts come from the routes currently configured in TrustedRouter. Performance uses the same cached metadata snapshot as the public leaderboard. Prompts and outputs are not part of these measurements.
| Model | Providers | Context | Input | Output | Privacy | Measured route |
|---|---|---|---|---|---|---|
Meta: Llama 3.3 70B Instructmeta-llama/llama-3.3-70b-instruct |
+7
|
131,072 | $0.142425/1M to $1.84625/1M | $0.422/1M to $2.90125/1M | E2EE 6 cited scores | 1096 ms TTFT tinfoil · 100.00% available · n=25 |
Mistral: Mistral Nemomistralai/mistral-nemo |
|
131,072 | $0.025848/1M to $0.0422/1M | $0.103179/1M to $0.17935/1M | E2EE | 1015 ms TTFT mistral · 65 tok/s · 100.00% available · n=14 |
Mistral: Codestral 2508mistralai/codestral-2508 |
|
256,000 | $0.3165/1M | $0.9495/1M | varies | 1096 ms TTFT mistral · 100.00% available · n=13 |
Anthropic: Claude Sonnet 5anthropic/claude-sonnet-5 |
|
1,000,000 | $2.11/1M | $10.55/1M to $15.825/1M | varies | 1017 ms TTFT anthropic · 100.00% available · n=10 |
Meta: Llama 3.1 8B Instructmeta-llama/llama-3.1-8b-instruct |
|
131,072 | $0.0211/1M to $0.2321/1M | $0.05275/1M to $0.47475/1M | varies | 1479 ms TTFT telnyx · 100.00% available · n=8 |
Meta: Llama 3.1 70B Instructmeta-llama/llama-3.1-70b-instruct |
|
131,072 | $0.422/1M to $0.844/1M | $0.422/1M to $0.844/1M | varies | 1454 ms TTFT telnyx · 100.00% available · n=6 |
Browse every modelReview provider policiesOpen the full leaderboardSnapshot 2026-09-07T09:16:50.445Z
Questions
Does TrustedRouter run the same Claude models as AWS Bedrock?
Yes. TrustedRouter routes Claude alongside GPT, Gemini, DeepSeek, Kimi, Qwen, GLM, MiniMax, Llama, Mistral, and more: 220+ model routes across 30+ providers behind one OpenAI-compatible API. When a provider is down, traffic rolls over automatically, and meta-routes such as trustedrouter/auto select the best-fit route for each request.
Is TrustedRouter HIPAA compliant like Bedrock's HIPAA-eligible services?
TrustedRouter does not claim HIPAA or SOC 2 certification. It provides a verifiable architecture plus readiness documentation your compliance team can assess: HIPAA and SOC 2 readiness pages, a DPA, a BAA, and a subprocessor list. The prompt path runs in a hardware-attested confidential-compute gateway. TrustedRouter never logs prompt or output content. Ordinary synchronous and streaming inference does not retain it. The opt-in Batch API temporarily retains enclave-encrypted artifacts for up to 30 days. Regulated teams should review the readiness documentation and must approve Batch separately.
How do I verify TrustedRouter's privacy claims before migrating from Bedrock?
Fetch a live attestation: call the attestation endpoint with a nonce and you get a JWT signed by the CPU vendor's root key. The image digest in the token matches the published open-source gateway artifact, and the attestation binds to your live TLS session, so it cannot be replayed. Bedrock asks you to trust the AWS account boundary; TrustedRouter gives you a check you can run yourself.
What does TrustedRouter cost compared to Bedrock?
TrustedRouter publishes transparent per-model pricing with a thin markup over provider list prices; check the pricing page for current numbers. You can pay with prepaid credits via Stripe, bring your own provider keys, or pay per request with x402 crypto and a MetaMask wallet sign-in. Note that TrustedRouter spend does not draw down an AWS EDP commitment, unlike Bedrock usage.