Llama 3.3 70B Instruct API

All models

Use the same OpenAI compatible clients you already use. Only the base URL and model change.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.trustedrouter.com/v1",
    api_key="sk-tr-v1-..."
)

response = client.chat.completions.create(
    model="meta-llama/Llama-3.3-70B-Instruct",
    messages=[{"role": "user", "content": "Give me a one-sentence status."}],
    max_tokens=64,
)
print(response.choices[0].message.content)

Endpoint metadata: https://api.trustedrouter.com/v1/models/meta-llama/Llama-3.3-70B-Instruct/endpoints