Baltor Get started

Endpoints

Nvidia

A hosted service with its own key and prices. This page lists the addresses it answers, the facts its documentation states, and the setup of each harness.

Addresses and facts

  • OpenAI Chat Completions: https://integrate.api.nvidia.com/v1 models.dev, read
Authentication
Authorization: Bearer, with the key in NVIDIA_API_KEY models.dev, read
Structured output
Unknown
Tool calling
66 of 105 listed models The share of this provider's models that models.dev records with tool calling. models.dev, read
Rate limits
Unknown
Prices
Unknown
Data retention
Unknown
Documentation
Read the page models.dev, read
Output limits Baltor recorded
Unknown

Harness setup

Replace abacusai/dracarys-llama-3.1-70b-instruct with the model you want.

OpenCode

Put this in opencode.json in your project folder:

{
  "$schema": "https://opencode.ai/config.json",
  "provider": {
    "nvidia": {
      "npm": "@ai-sdk/openai-compatible",
      "name": "Nvidia",
      "options": {
        "baseURL": "https://integrate.api.nvidia.com/v1",
        "apiKey": "{env:NVIDIA_API_KEY}"
      },
      "models": {
        "abacusai/dracarys-llama-3.1-70b-instruct": {
          "name": "abacusai/dracarys-llama-3.1-70b-instruct"
        }
      }
    }
  }
}
  • OpenCode reads any OpenAI-compatible address through the @ai-sdk/openai-compatible package, and an address that speaks the Responses API through @ai-sdk/openai.

From OpenCode documentation, read .

Pi

Put this in ~/.pi/agent/models.json:

{
  "providers": {
    "nvidia": {
      "baseUrl": "https://integrate.api.nvidia.com/v1",
      "api": "openai-completions",
      "apiKey": "$NVIDIA_API_KEY",
      "models": [
        {
          "id": "abacusai/dracarys-llama-3.1-70b-instruct"
        }
      ]
    }
  }
}
  • The apiKey field can name an environment variable as $NAME.

From Pi documentation, read .

Codex

Codex speaks only the Responses API, and Nvidia documents no Responses address. A gateway that offers one can sit in between.

  • Codex speaks the Responses API only: responses is the one supported wire API of a custom provider. Ollama and LM Studio are built in and start with --oss.

From Codex documentation, read .

Claude Code

Claude Code sends Anthropic Messages requests, and Nvidia documents no such address. A gateway that translates to that API can sit in between.

  • Claude Code sends Anthropic Messages requests to ANTHROPIC_BASE_URL. Anthropic says it does not support routing Claude Code to models other than Claude through any gateway, so some features may not work with another model.

From Claude Code documentation, read .

Models it lists

Prices in US dollars per million tokens, input and output, as models.dev, read records them.

ModelInputOutputContextAs of
dracarys-llama-3.1-70b-instruct abacusai/dracarys-llama-3.1-70b-instruct0 USD0 USD128,000 older than 30 days
BGE M3 baai/bge-m30 USD0 USD8,192 older than 30 days
FLUX.1-dev black-forest-labs/flux.1-dev0 USD0 USD4,096 older than 30 days
FLUX.1-Kontext-dev black-forest-labs/flux_1-kontext-dev0 USD0 USD40,960 older than 30 days
FLUX.1-schnell black-forest-labs/flux_1-schnell0 USD0 USD77 older than 30 days
FLUX.2 Klein 4B black-forest-labs/flux_2-klein-4b0 USD0 USD40,960 older than 30 days
ByteDance-Seed/Seed-OSS-36B-Instruct bytedance/seed-oss-36b-instruct0 USD0 USD262,000 older than 30 days
DeepSeek V4 Flash deepseek-ai/deepseek-v4-flash0.140 USD0.280 USD1,048,576 older than 30 days
DeepSeek V4 Flash 0731 deepseek-ai/deepseek-v4-flash-07310 USD0 USD1,000,000 older than 30 days
DeepSeek V4 Pro deepseek-ai/deepseek-v4-pro0.435 USD0.870 USD1,048,576 older than 30 days
DeepSeek V4 Pro 0813 deepseek-ai/deepseek-v4-pro-08130 USD0 USD1,000,000 older than 30 days
Gemma 2 2b It google/gemma-2-2b-it0 USD0 USD128,000 older than 30 days
Gemma 3 12B IT google/gemma-3-12b-it0 USD0 USD131,072 older than 30 days
Gemma 3 4B IT google/gemma-3-4b-it0 USD0 USD131,072 older than 30 days
Gemma 3n E2b It google/gemma-3n-e2b-it0 USD0 USD128,000 older than 30 days
Gemma 3n E4b It google/gemma-3n-e4b-it0 USD0 USD128,000 older than 30 days
Gemma-4-31B-IT google/gemma-4-31b-it0 USD0 USD256,000 older than 30 days
paligemma google/google-paligemma0 USD0 USD128,000 older than 30 days
esm2-650m meta/esm2-650m0 USD0 USD128,000 older than 30 days
esmfold meta/esmfold0 USD0 USD128,000 older than 30 days
Llama 3.1 70b Instruct meta/llama-3.1-70b-instruct0 USD0 USD128,000 older than 30 days
Llama 3.1 8B Instruct meta/llama-3.1-8b-instruct0 USD0 USD16,000 older than 30 days
Llama 3.2 11b Vision Instruct meta/llama-3.2-11b-vision-instruct0 USD0 USD128,000 older than 30 days
Llama 3.2 1b Instruct meta/llama-3.2-1b-instruct0 USD0 USD128,000 older than 30 days
Llama 3.2 3B Instruct meta/llama-3.2-3b-instruct0 USD0 USD32,768 older than 30 days
Llama-3.2-90B-Vision-Instruct meta/llama-3.2-90b-vision-instruct0 USD0 USD128,000 older than 30 days
Llama 3.3 70b Instruct meta/llama-3.3-70b-instruct0 USD0 USD128,000 older than 30 days
Llama 4 Maverick 17b 128e Instruct meta/llama-4-maverick-17b-128e-instruct0 USD0 USD128,000 older than 30 days
Llama Guard 4 12B meta/llama-guard-4-12b0 USD0 USD128,000 older than 30 days
Muse Glimmer 30B meta/muse-glimmer-30b0 USD0 USD131,072 older than 30 days
Phi-4-Mini microsoft/phi-4-mini-instruct0 USD0 USD131,072 older than 30 days
Phi 4 Multimodal microsoft/phi-4-multimodal-instruct0 USD0 USD128,000 older than 30 days
MiniMax-M2.7 minimaxai/minimax-m2.70 USD0 USD204,800 older than 30 days
MiniMax-M3 minimaxai/minimax-m30 USD0 USD1,000,000 older than 30 days
Magistral Small 2506 mistralai/magistral-small-25060 USD0 USD32,768 older than 30 days
Ministral 3 14B Instruct 2512 mistralai/ministral-14b-instruct-25120 USD0 USD262,144 older than 30 days
Mistral-7B-Instruct-v0.3 mistralai/mistral-7b-instruct-v0.30 USD0 USD65,536 older than 30 days
Mistral Large 3 675B Instruct 2512 mistralai/mistral-large-3-675b-instruct-25120 USD0 USD262,144 older than 30 days
Mistral Medium 3 mistralai/mistral-medium-3-instruct0 USD0 USD131,072 older than 30 days
Mistral Medium 3.5 mistralai/mistral-medium-3.5-128b0 USD0 USD262,144 older than 30 days
mistral-nemotron mistralai/mistral-nemotron0 USD0 USD128,000 older than 30 days
mistral-small-4-119b-2603 mistralai/mistral-small-4-119b-26030 USD0 USD128,000 older than 30 days
Mistral: Mixtral 8x22B Instruct mistralai/mixtral-8x22b-instruct0 USD0 USD65,536 older than 30 days
Mistral: Mixtral 8x7B Instruct mistralai/mixtral-8x7b-instruct0 USD0 USD32,768 older than 30 days
Kimi K2 0905 moonshotai/kimi-k2-instruct-09050 USD0 USD262,144 older than 30 days
Kimi K2.6 moonshotai/kimi-k2.60 USD0 USD262,144 older than 30 days
Kimi K3 moonshotai/kimi-k30 USD0 USD1,048,576 older than 30 days
Active Speaker Detection nvidia/active-speaker-detection0 USD0 USDUnknown older than 30 days
bevformer nvidia/bevformer0 USD0 USD128,000 older than 30 days
cosmos-predict1-5b nvidia/cosmos-predict1-5b0 USD0 USDUnknown older than 30 days
Cosmos Reason2 8B nvidia/cosmos-reason2-8b0 USD0 USD131,072 older than 30 days
cosmos-transfer1-7b nvidia/cosmos-transfer1-7b0 USD0 USDUnknown older than 30 days
cosmos-transfer2.5-2b nvidia/cosmos-transfer2_5-2b0 USD0 USDUnknown older than 30 days
gliner-pii nvidia/gliner-pii0 USD0 USD128,000 older than 30 days
Llama 3.1 Nemotron 70B Instruct nvidia/llama-3.1-nemotron-70b-instruct0 USD0 USD128,000 older than 30 days
Llama 3.1 Nemotron Nano 8B v1 nvidia/llama-3.1-nemotron-nano-8b-v10 USD0 USD131,072 older than 30 days
Llama 3.1 Nemotron Nano VL 8B v1 nvidia/llama-3.1-nemotron-nano-vl-8b-v10 USD0 USD32,768 older than 30 days
llama-3.1-nemotron-safety-guard-8b-v3 nvidia/llama-3.1-nemotron-safety-guard-8b-v30 USD0 USD128,000 older than 30 days
Llama 3.1 Nemotron Ultra 253B nvidia/llama-3.1-nemotron-ultra-253b-v10 USD0 USD128,000 older than 30 days
Llama 3.3 Nemotron Super 49B v1 nvidia/llama-3.3-nemotron-super-49b-v10 USD0 USD131,072 older than 30 days
Llama 3.3 Nemotron Super 49B v1.5 nvidia/llama-3.3-nemotron-super-49b-v1.50 USD0 USD131,072 older than 30 days
llama-3_2-nemoretriever-300m-embed-v1 nvidia/llama-3_2-nemoretriever-300m-embed-v10 USD0 USD32,768 older than 30 days
llama-nemotron-embed-vl-1b-v2 nvidia/llama-nemotron-embed-vl-1b-v20 USD0 USD32,768 older than 30 days
llama-nemotron-rerank-vl-1b-v2 nvidia/llama-nemotron-rerank-vl-1b-v20 USD0 USD128,000 older than 30 days
magpie-tts-zeroshot nvidia/magpie-tts-zeroshot0 USD0 USDUnknown older than 30 days
nemotron-3-content-safety nvidia/nemotron-3-content-safety0 USD0 USD128,000 older than 30 days
nemotron-3-nano-30b-a3b nvidia/nemotron-3-nano-30b-a3b0 USD0 USD131,072
Nemotron 3 Nano Omni nvidia/nemotron-3-nano-omni-30b-a3b-reasoning0 USD0 USD256,000 older than 30 days
Nemotron 3 Super nvidia/nemotron-3-super-120b-a12b0.200 USD0.800 USD262,144 older than 30 days
Nemotron 3 Ultra 550B A55B nvidia/nemotron-3-ultra-550b-a55b0.500 USD2.50 USD1,000,000 older than 30 days
Nemotron 3.5 Lightning 30B A3B nvidia/nemotron-3.5-lightning-30b-a3b0 USD0 USD262,144 older than 30 days
nemotron-content-safety-reasoning-4b nvidia/nemotron-content-safety-reasoning-4b0 USD0 USD128,000 older than 30 days
nemotron-mini-4b-instruct nvidia/nemotron-mini-4b-instruct0 USD0 USD128,000 older than 30 days
Nemotron Nano 12B v2 VL nvidia/nemotron-nano-12b-v2-vl0 USD0 USD128,000 older than 30 days
nemotron-voicechat nvidia/nemotron-voicechat0 USD0 USD128,000 older than 30 days
nv-embed-v1 nvidia/nv-embed-v10 USD0 USD32,768 older than 30 days
nv-embedcode-7b-v1 nvidia/nv-embedcode-7b-v10 USD0 USD32,768 older than 30 days
nvidia-nemotron-nano-9b-v2 nvidia/nvidia-nemotron-nano-9b-v20 USD0 USD131,072 older than 30 days
rerank-qa-mistral-4b nvidia/rerank-qa-mistral-4b0 USD0 USD128,000 older than 30 days
riva-translate-4b-instruct-v1_1 nvidia/riva-translate-4b-instruct-v1.10 USD0 USD128,000 older than 30 days
sparsedrive nvidia/sparsedrive0 USD0 USD128,000 older than 30 days
streampetr nvidia/streampetr0 USD0 USD128,000 older than 30 days
studiovoice nvidia/studiovoice0 USD0 USD128,000 older than 30 days
synthetic-video-detector nvidia/synthetic-video-detector0 USD0 USDUnknown older than 30 days
usdcode nvidia/usdcode0 USD0 USD128,000 older than 30 days
usdvalidate nvidia/usdvalidate0 USD0 USDUnknown older than 30 days
GPT-OSS-120B openai/gpt-oss-120b0 USD0 USD128,000 older than 30 days
GPT OSS 20B openai/gpt-oss-20b0 USD0 USD131,072 older than 30 days
Whisper Large v3 openai/whisper-large-v30 USD0 USDUnknown older than 30 days
Laguna XS 2.1 poolside/laguna-xs-2.10 USD0 USD262,144 older than 30 days
Qwen Image qwen/qwen-image0 USD0 USDUnknown older than 30 days
Qwen Image Edit qwen/qwen-image-edit0 USD0 USDUnknown older than 30 days
Qwen2.5 Coder 32b Instruct qwen/qwen2.5-coder-32b-instruct0 USD0 USD128,000 older than 30 days
Qwen3 Coder 480B A35B Instruct qwen/qwen3-coder-480b-a35b-instruct0 USD0 USD262,144 older than 30 days
Qwen3-Next-80B-A3B-Instruct qwen/qwen3-next-80b-a3b-instruct0 USD0 USD262,144 older than 30 days
Qwen3.5 122B-A10B qwen/qwen3.5-122b-a10b0 USD0 USD262,144 older than 30 days
Qwen3.5-397B-A17B qwen/qwen3.5-397b-a17b0 USD0 USD262,144 older than 30 days
sarvam-m sarvamai/sarvam-m0 USD0 USD128,000 older than 30 days
Step 3.5 Flash stepfun-ai/step-3.5-flash0 USD0 USD256,000 older than 30 days
Step 3.7 Flash stepfun-ai/step-3.7-flash0 USD0 USD256,000 older than 30 days
Inkling thinkingmachines/inkling0 USD0 USD1,048,576 older than 30 days
solar-10.7b-instruct upstage/solar-10.7b-instruct0 USD0 USD128,000 older than 30 days
GLM-5.2 z-ai/glm-5.20 USD0 USD1,000,000 older than 30 days
GLM-5.3 z-ai/glm-5.30 USD0 USD1,000,000 older than 30 days
GLM-5.3-Flash z-ai/glm-5.3-flash0 USD0 USD1,000,000

Sources of this page