Llama 3.1 8B Instruct
Open-weights chat model from Meta. One API key reaches all 3 providers, with automatic failover.
No card required. Start with 1 million free tokens.
About Llama 3.1 8B Instruct
Llama 3.1 8B Instruct is an open-weights chat model published by Meta, with a 131,072-token context window. Through TrustedRouter it runs on 3 providers, with options in the US, from $0.021 per million input tokens.
- Model ID
meta-llama/llama-3.1-8b-instruct- Publisher
- Meta
- Modes
- chat
- Billing
- Credits or your own provider key
Set it up with your agent
Paste this into Claude Code, Cursor or any coding agent.
Use Llama 3.1 8B Instruct through TrustedRouter in this project.
1. Read https://trustedrouter.com/llms.txt
2. Point the OpenAI-compatible client at
https://api.trustedrouter.com/v1 and read the key from
TRUSTEDROUTER_API_KEY.
3. Set the model to meta-llama/llama-3.1-8b-instruct.
4. Run the tests, then show me the diff before committing.import os
from openai import OpenAI
client = OpenAI(
base_url="https://api.trustedrouter.com/v1",
api_key=os.environ["TRUSTEDROUTER_API_KEY"],
)
response = client.chat.completions.create(
model="meta-llama/llama-3.1-8b-instruct",
messages=[{"role": "user", "content": "What is the capital of France?"}],
)
print(response.choices[0].message.content)curl https://api.trustedrouter.com/v1/chat/completions \
-H "Authorization: Bearer $TRUSTEDROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "meta-llama/llama-3.1-8b-instruct",
"messages": [{"role": "user", "content": "What is the capital of France?"}]
}'Providers
Your key goes to the cheapest healthy provider and fails over on its own. Open a row for retention, location and weight format, or see how we check privacy claims and the live speed leaderboard.
| Provider | Input | Cached | Output | Cost per 1M in + out | Details |
|---|---|---|---|---|---|
Novita AI
Cheapest
|
$0.0211 | — | $0.0528 | $0.074 | |
|
Retention Verification: privacy unknown. No provider-ZDR claim is tracked here. Novita's privacy policy says personal information is not used for model training; customer-content processing is governed by customer agreements. Location Operator country: US Headquarters / registered office: San Francisco, California, United States. Company location source (reviewed 2026-09-27). Inference: Shared inference API; processing countries unconfirmed, no fixed-region commitment. No exhaustive inference-country list verified for the shared model API. Novita publishes worldwide GPU rental regions, but that separate product does not establish shared serverless model placement. Region pinning through TR: Not supported by the current TrustedRouter integration. Reviewed 2026-10-28. Weight format Unknown Price and speed Input $0.0211/1M · Cached input Not published · Output $0.05275/1M TTFT: insufficient data Speed: insufficient data |
|||||
Weights & Biases
|
$0.232 | — | $0.232 | $0.46 | |
|
Retention Verification: no verified privacy claim. W&B Serverless Inference runs on CoreWeave infrastructure. W&B does not publish a zero-retention, confidential-compute, or end-to-end-encryption commitment for this service, so these routes use the Standard privacy tier. TrustedRouter does not enable W&B Weave tracing for provider calls. Location Operator country: US Headquarters / registered office: Not verified. Inference: Inference location not verified; no country-specific residency commitment. No inference-location declaration has been verified for this provider. Region pinning through TR: No verified provider-specific location pin documented here. Weight format Unknown Price and speed Input $0.2321/1M · Cached input Not published · Output $0.2321/1M TTFT: 0.23 s Speed: insufficient data Last sample: |
|||||
Databricks
|
$0.158 | — | $0.475 | $0.63 | |
|
Retention Verification: no verified privacy claim. Databricks Foundation Model APIs are a Designated Service and pay-per-token workloads are HIPAA compliant. Databricks may temporarily process or store inputs and outputs for abuse prevention, and may process data outside the originating cloud or region. This route is therefore standard privacy, not ZDR, confidential compute, or end-to-end encrypted. Location Operator country: US Headquarters / registered office: Not verified. Inference: Inference location not verified; no country-specific residency commitment. No inference-location declaration has been verified for this provider. Region pinning through TR: No verified provider-specific location pin documented here. Weight format Unknown Price and speed Input $0.15825/1M · Cached input Not published · Output $0.47475/1M TTFT: 1.70 s Speed: insufficient data Last sample: |
|||||
Append :nitro to the model ID, or send "provider": {"sort": "throughput"}, to route to the fastest provider instead.
Questions
What model ID should I use for Llama 3.1 8B Instruct?
Use meta-llama/llama-3.1-8b-instruct as the model field with the TrustedRouter OpenAI-compatible API. Credits routing and provider fallback happen behind that model ID.
Do you log my prompts or outputs?
No. Prompt and output content are intentionally excluded from the control plane and metadata systems. Optional content export requires explicit destination-level configuration.
Which providers serve Llama 3.1 8B Instruct?
TrustedRouter currently lists Novita AI, Databricks, and Weights & Biases for Llama 3.1 8B Instruct. Provider availability and routing eligibility can change as catalog and health data update.
How much does Llama 3.1 8B Instruct cost through TrustedRouter?
The current lowest Credits input price is $0.0211/1M and the lowest Credits output price is $0.05275/1M. Prices are per one million tokens and come from the current route catalog.
How do I require zero data retention for Llama 3.1 8B Instruct?
Set provider.min_privacy to zdr on the request. TrustedRouter considers only routes with a recorded zero-data-retention posture and fails closed if no eligible route remains.
Llama 3.1 8B Instruct vs other models
Start building with Llama 3.1 8B Instruct.
No card required. Start with 1 million free tokens.