NVIDIA NIM
Explore NVIDIA NIM models on TrustedRouter with current routes, token pricing, policy sources, privacy posture, regional availability, and API support.
NVIDIA NIMnvidia-nim
No provider claim
| Provider | NVIDIA NIM |
|---|---|
| Routing status | Active |
| Provider website | https://build.nvidia.com/ |
| Models | 12 public models |
| Credits routes | 12 |
| Zero data retention | no |
| Confidential compute | no |
| Provider E2EE | no |
| Policy note | NVIDIA's hosted NIM API Catalog endpoints are preview services for development and prototyping. TrustedRouter exposes chat-capable models from its configured API Catalog key as Standard routes. NVIDIA requires an NVIDIA AI Enterprise entitlement for production deployments. NVIDIA does not publish hosted preview token rates, so TrustedRouter uses a conservative fallback price and excludes these routes from price indexing. Policy source |
Measured performance
27 samplesContinuously sampled across NVIDIA NIM's routed models: p50 TTFT, effective throughput, and success rate. Effective throughput uses provider-reported output tokens over complete request time. Unsupported route and probe-configuration rows are separated from provider downtime. No prompt or output content stored.
| p50 TTFT | 1391 ms |
|---|---|
| Effective throughput | 22 tok/s n=1 |
| Uptime | 51.85% |
| Model | p50 TTFT | Effective throughput | Uptime | Config excluded | Availability samples |
|---|---|---|---|---|---|
| meta-llama/llama-3.2-11b-vision-instruct | 882 ms | — | 80.00% | — | 5 |
| poolside/laguna-xs-2.1 | 887 ms | — | 100.00% | — | 1 |
| nvidia/nemotron-3.5-lightning-30b-a3b | 982 ms | — | 100.00% | — | 1 |
| nvidia/nemotron-3-nano-omni-30b-a3b-reasoning | 1012 ms | — | 50.00% | — | 2 |
| nvidia/nemotron-3-super-120b-a12b | 1391 ms | — | 100.00% | — | 4 |
| openai/gpt-oss-20b | 1698 ms | — | 100.00% | — | 1 |
| mistralai/mistral-nemotron | 2196 ms | — | 28.57% | — | 7 |
| deepseek/deepseek-v4-flash-0731 | — | — | 0.00% | 1 provider_error |
3 |
| google/gemma-4-31b-it | — | — | 0.00% | — | 1 |
| minimax/minimax-m3 | — | — | 0.00% | — | 2 |
| moonshotai/kimi-k3 | — | 22 tok/s n=1 | — | — | 0 |
NVIDIA NIM performance history · Full provider & model leaderboard.
Models served by NVIDIA NIM.
Each row links to pricing, provider, benchmark, and API pages for the model.
| Model | AI IQ | Context | Input | Cached input | Output |
|---|---|---|---|---|---|
deepseek/deepseek-v4-flash-0731DeepSeek: DeepSeek V4 Flash 0731 |
— | 1,048,576 | $2.11/1M | Not published | $10.55/1M |
google/gemma-4-31b-itGoogle: Gemma 4 31B |
IQ 101#80 | 262,144 | $2.11/1M | Not published | $10.55/1M |
meta-llama/llama-3.2-11b-vision-instruct@cf/meta/llama-3.2-11b-vision-instruct |
— | 128,000 | $2.11/1M | Not published | $10.55/1M |
minimax/minimax-m3MiniMax: MiniMax M3 |
IQ 114#44 | 524,288 | $2.11/1M | Not published | $10.55/1M |
mistralai/mistral-nemotronmistralai/mistral-nemotron |
— | 0 | $2.11/1M | Not published | $10.55/1M |
moonshotai/kimi-k3MoonshotAI: Kimi K3 |
IQ 123#21 | 1,048,576 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3-nano-omni-30b-a3b-reasoningnvidia/nemotron-3-nano-omni-30b-a3b-reasoning |
— | 0 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3-super-120b-a12bNVIDIA: Nemotron 3 Super |
— | 262,144 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3-ultra-550b-a55bNVIDIA: Nemotron 3 Ultra |
— | 256,000 | $2.11/1M | Not published | $10.55/1M |
nvidia/nemotron-3.5-lightning-30b-a3bnvidia/Nemotron-3.5-Lightning-30B-A3B |
— | 262,144 | $2.11/1M | Not published | $10.55/1M |
openai/gpt-oss-20bOpenAI: gpt-oss-20b |
IQ 100#86 | 131,072 | $2.11/1M | Not published | $10.55/1M |
poolside/laguna-xs-2.1poolside/laguna-xs-2.1 |
— | 0 | $2.11/1M | Not published | $10.55/1M |
Questions
Does NVIDIA NIM have zero data retention?
TrustedRouter does not currently mark NVIDIA NIM as provider-level zero data retention. Use trustedrouter/zdr or provider.min_privacy=zdr to select a different eligible route, and review the linked policy source for changes.
Is NVIDIA NIM end-to-end encrypted?
TrustedRouter does not currently mark NVIDIA NIM as end-to-end encrypted at the provider boundary. The TrustedRouter gateway is still attested, but the selected provider normally receives the request in order to run the model. Use trustedrouter/e2e for the stronger route requirement.
Which NVIDIA NIM models are available through TrustedRouter?
This page currently lists 12 public NVIDIA NIM models, with live pricing, route count, context length, measured performance when available, and links to each model's provider and benchmark pages.