OpenAI compatible API. Attested gateway. Public status.

LiteLLM Alternative — Self-Host and Verify It

A LiteLLM alternative that's self-hostable AND verifiable. Hardware-attested gateway proves the no-logging guarantee.

Verify gateway

1 URLbase_url migration

100smodels and routes

0prompt logs by default

LiteLLM alternative

LiteLLM lets you self-host. TrustedRouter lets you self-host and prove it.

LiteLLM is a great open-source proxy: one OpenAI-compatible API across 100+ models, runs in your own infra. The gap is verification — once it's deployed, nobody outside your ops team can confirm what the running proxy actually does with a prompt.

TrustedRouter closes that gap. The gateway runs in hardware enclaves and signs the exact binary it's running, so the no-logging guarantee is cryptographically checkable — by you, your auditors, or your customers.

Try the playground How verification works

Same OpenAI-compatible shapePython

client = OpenAI(
    base_url="https://api.trustedrouter.com/v1",
    api_key="sk-tr-v1-..."
)
# Drop-in for any LiteLLM proxy integration.
# Self-host TR too — your built image hash is the
# hash your enclave reports, so attestation holds.

Self-host

Run it in your own VPC.

Like LiteLLM, the full stack is open source and self-hostable. Unlike LiteLLM, the deployment is attestable end to end.

Verifiable

Prove the no-log claim.

Build the image, deploy to a confidential VM, and the attestation reports your hash. Your security team verifies instead of trusting your runbook.

Hosted option

Or skip the ops entirely.

Don't want to run a proxy? Use the hosted attested gateway at api.trustedrouter.com — same verification, zero infra.

LiteLLMTrustedRouter

Open sourceYesYes

Self-hostYesYes

Hosted optionLiteLLM CloudAttested hosted gateway

Verifiable runtimeNo — trust your deployYes — hardware attestation

No-log guaranteeConfigurableStructural + verifiable in source

Best fitTeams that want a self-hosted proxyTeams that must prove what the proxy does

When to choose TR over LiteLLM

When "trust our deployment" isn't enough.

If your security review, your customers, or your regulator needs evidence — not assurances — that prompts aren't logged, a self-hosted proxy alone doesn't get you there. Attestation does.

Read the full argument: “Attestation is All You Need”.