NVIDIA NIM
Explore NVIDIA NIM models on TrustedRouter with current routes, token pricing, policy sources, privacy posture, regional availability, and API support.
NVIDIA NIMnvidia-nim
No provider claim| Provider | NVIDIA NIM |
|---|---|
| Routing status | Active |
| Provider website | https://build.nvidia.com/ |
| Models | 15 public models |
| Credits routes | 15 |
| BYOK routes | 0 |
| Zero data retention | no |
| Confidential compute | no |
| Provider E2EE | no |
| Policy note | NVIDIA's hosted NIM API Catalog endpoints are preview services for development and prototyping. TrustedRouter exposes chat-capable models from its configured API Catalog key as Standard routes. NVIDIA requires an NVIDIA AI Enterprise entitlement for production deployments. NVIDIA does not publish hosted preview token rates, so TrustedRouter uses a conservative fallback price and excludes these routes from price indexing. Policy source |
Measured performance
5 samplesContinuously sampled across NVIDIA NIM's routed models: p50 TTFT, effective throughput, and success rate. Effective throughput uses provider-reported output tokens over complete request time. Unsupported route and probe-configuration rows are separated from provider downtime. No prompt or output content stored.
| p50 TTFT | 2052 ms |
|---|---|
| Effective throughput | 10 tok/s n=1 |
| Uptime | 60.00% |
| Model | p50 TTFT | Effective throughput | Uptime | Config excluded | Availability samples |
|---|---|---|---|---|---|
| openai/gpt-oss-120b | 982 ms | — | 100.00% | — | 1 |
| nvidia/nemotron-3-ultra-550b-a55b | 2052 ms | — | 100.00% | — | 1 |
| nvidia/nemotron-3-nano-omni-30b-a3b-reasoning | 2428 ms | — | 50.00% | — | 2 |
| deepseek/deepseek-v4-flash-0731 | — | — | 0.00% | — | 1 |
| minimax/minimax-m3 | — | 10 tok/s n=1 | — | — | 0 |
NVIDIA NIM performance history · Full provider & model leaderboard.
Models served by NVIDIA NIM.
Each row links to pricing, provider, benchmark, and API pages for the model.
| Model | AI IQ | Context | Endpoints | Prompt | Completion | Routes |
|---|---|---|---|---|---|---|
deepseek/deepseek-v4-flash-0731DeepSeek: DeepSeek V4 Flash 0731 |
— | 1,310,720 | 1 | $2.11/1M | $10.55/1M | prepaid |
google/gemma-4-31b-itGoogle: Gemma 4 31B |
IQ 101#80 | 262,144 | 1 | $2.11/1M | $10.55/1M | prepaid |
meta-llama/llama-3.2-11b-vision-instruct@cf/meta/llama-3.2-11b-vision-instruct |
— | 128,000 | 1 | $2.11/1M | $10.55/1M | prepaid |
meta-llama/llama-3.2-90b-vision-instructmeta/llama-3.2-90b-vision-instruct |
— | 0 | 1 | $2.11/1M | $10.55/1M | prepaid |
minimax/minimax-m3MiniMax: MiniMax M3 |
IQ 114#42 | 1,048,576 | 1 | $2.11/1M | $10.55/1M | prepaid |
mistralai/mistral-nemotronmistralai/mistral-nemotron |
— | 0 | 1 | $2.11/1M | $10.55/1M | prepaid |
moonshotai/kimi-k3MoonshotAI: Kimi K3 |
IQ 123#17 | 1,048,576 | 1 | $2.11/1M | $10.55/1M | prepaid |
nvidia/nemotron-3-nano-30b-a3bNVIDIA: Nemotron 3 Nano 30B A3B |
— | 262,144 | 1 | $2.11/1M | $10.55/1M | prepaid |
nvidia/nemotron-3-nano-omni-30b-a3b-reasoningnvidia/nemotron-3-nano-omni-30b-a3b-reasoning |
— | 0 | 1 | $2.11/1M | $10.55/1M | prepaid |
nvidia/nemotron-3-super-120b-a12bNVIDIA: Nemotron 3 Super |
— | 1,000,000 | 1 | $2.11/1M | $10.55/1M | prepaid |
nvidia/nemotron-3-ultra-550b-a55bNVIDIA: Nemotron 3 Ultra |
— | 262,144 | 1 | $2.11/1M | $10.55/1M | prepaid |
nvidia/nemotron-3.5-lightning-30b-a3bnvidia/Nemotron-3.5-Lightning-30B-A3B |
— | 262,144 | 1 | $2.11/1M | $10.55/1M | prepaid |
openai/gpt-oss-120bOpenAI: gpt-oss-120b |
IQ 105#67 | 131,072 | 1 | $2.11/1M | $10.55/1M | prepaid |
openai/gpt-oss-20bOpenAI: gpt-oss-20b |
IQ 100#84 | 131,072 | 1 | $2.11/1M | $10.55/1M | prepaid |
poolside/laguna-xs-2.1poolside/laguna-xs-2.1 |
— | 0 | 1 | $2.11/1M | $10.55/1M | prepaid |
Questions
Does NVIDIA NIM have zero data retention?
TrustedRouter does not currently mark NVIDIA NIM as provider-level zero data retention. Use trustedrouter/zdr or provider.min_privacy=zdr to select a different eligible route, and review the linked policy source for changes.
Is NVIDIA NIM end-to-end encrypted?
TrustedRouter does not currently mark NVIDIA NIM as end-to-end encrypted at the provider boundary. The TrustedRouter gateway is still attested, but the selected provider normally receives the request in order to run the model. Use trustedrouter/e2e for the stronger route requirement.
Which NVIDIA NIM models are available through TrustedRouter?
This page currently lists 15 public NVIDIA NIM models, with live pricing, route count, context length, measured performance when available, and links to each model's provider and benchmark pages.