Llama 3_1 Nemotron Ultra 253B v1 API

All models

Use the same OpenAI compatible clients you already use. Only the base URL and model change.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.trustedrouter.com/v1",
    api_key="sk-tr-v1-..."
)

response = client.chat.completions.create(
    model="nvidia/Llama-3_1-Nemotron-Ultra-253B-v1",
    messages=[{"role": "user", "content": "Give me a one-sentence status."}],
    max_tokens=64,
)
print(response.choices[0].message.content)

Endpoint metadata: https://api.trustedrouter.com/v1/models/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1/endpoints