Together AI
A hosted service with its own key and prices. This page lists the addresses it answers, the facts its documentation states, and the setup of each harness.
Addresses and facts
- OpenAI Chat Completions:
https://api.together.ai/v1provider documentation, read
- Authentication
- Authorization: Bearer, with the key in
TOGETHER_API_KEYprovider documentation, read - Structured output
- Yes provider documentation, read
- Tool calling
- Yes provider documentation, read
- Rate limits
- Read the page provider documentation, read
- Prices
- Read the page provider documentation, read
- Data retention
- Together documents what it stores from inputs and outputs, and offers zero data retention. Read the page provider documentation, read
- Documentation
- Unknown
- Output limits Baltor recorded
- Unknown
Harness setup
Replace LiquidAI/LFM2-24B-A2B with the model you want.
OpenCode
Put this in opencode.json in your project folder:
{
"$schema": "https://opencode.ai/config.json",
"provider": {
"together": {
"npm": "@ai-sdk/openai-compatible",
"name": "Together AI",
"options": {
"baseURL": "https://api.together.ai/v1",
"apiKey": "{env:TOGETHER_API_KEY}"
},
"models": {
"LiquidAI/LFM2-24B-A2B": {
"name": "LiquidAI/LFM2-24B-A2B"
}
}
}
}
}- OpenCode reads any OpenAI-compatible address through the @ai-sdk/openai-compatible package, and an address that speaks the Responses API through @ai-sdk/openai.
From OpenCode documentation, read .
Pi
Put this in ~/.pi/agent/models.json:
{
"providers": {
"together": {
"baseUrl": "https://api.together.ai/v1",
"api": "openai-completions",
"apiKey": "$TOGETHER_API_KEY",
"models": [
{
"id": "LiquidAI/LFM2-24B-A2B"
}
]
}
}
}- The apiKey field can name an environment variable as $NAME.
From Pi documentation, read .
Codex
Codex speaks only the Responses API, and Together AI documents no Responses address. A gateway that offers one can sit in between.
- Codex speaks the Responses API only: responses is the one supported wire API of a custom provider. Ollama and LM Studio are built in and start with --oss.
From Codex documentation, read .
Claude Code
Claude Code sends Anthropic Messages requests, and Together AI documents no such address. A gateway that translates to that API can sit in between.
- Claude Code sends Anthropic Messages requests to ANTHROPIC_BASE_URL. Anthropic says it does not support routing Claude Code to models other than Claude through any gateway, so some features may not work with another model.
From Claude Code documentation, read .
Models it lists
Prices in US dollars per million tokens, input and output, as models.dev, read records them.
| Model | Input | Output | Context | As of |
|---|---|---|---|---|
LFM2-24B-A2B LiquidAI/LFM2-24B-A2B | 0.030 USD | 0.120 USD | 32,768 | older than 30 days |
MiniMax-M2.5 MiniMaxAI/MiniMax-M2.5 | 0.300 USD | 1.20 USD | 204,800 | older than 30 days |
MiniMax-M2.7 MiniMaxAI/MiniMax-M2.7 | 0.300 USD | 1.20 USD | 196,608 | older than 30 days |
MiniMax-M3 MiniMaxAI/MiniMax-M3 | 0.300 USD | 1.20 USD | 524,288 | older than 30 days |
Qwen 2.5 7B Instruct Turbo Qwen/Qwen2.5-7B-Instruct-Turbo | 0.300 USD | 0.300 USD | 32,768 | older than 30 days |
Qwen3 235B A22B Instruct 2507 FP8 Qwen/Qwen3-235B-A22B-Instruct-2507-tput | 0.200 USD | 0.600 USD | 262,144 | older than 30 days |
Qwen3 Coder 480B A35B Instruct Qwen/Qwen3-Coder-480B-A35B-Instruct-FP8 | 2.00 USD | 2.00 USD | 262,144 | older than 30 days |
Qwen3 Coder Next FP8 Qwen/Qwen3-Coder-Next-FP8 | 0.500 USD | 1.20 USD | 262,144 | older than 30 days |
Qwen3.5 397B A17B Qwen/Qwen3.5-397B-A17B | 0.600 USD | 3.60 USD | 262,144 | older than 30 days |
Qwen3.5 9B Qwen/Qwen3.5-9B | 0.170 USD | 0.250 USD | 262,144 | older than 30 days |
Qwen3.6 Plus Qwen/Qwen3.6-Plus | 0.500 USD | 3.00 USD | 1,000,000 | older than 30 days |
Qwen3.7 Max Qwen/Qwen3.7-Max | 1.25 USD | 3.75 USD | 1,000,000 | older than 30 days |
DeepSeek-R1 deepseek-ai/DeepSeek-R1 | 3.00 USD | 7.00 USD | 163,839 | older than 30 days |
DeepSeek-V3 deepseek-ai/DeepSeek-V3 | 1.25 USD | 1.25 USD | 131,072 | older than 30 days |
DeepSeek V3.1 deepseek-ai/DeepSeek-V3-1 | 0.600 USD | 1.70 USD | 131,072 | older than 30 days |
DeepSeek V4 Flash 0731 deepseek-ai/DeepSeek-V4-Flash-0731 | 0.140 USD | 0.280 USD | 1,048,576 | older than 30 days |
DeepSeek V4 Pro 0813 deepseek-ai/DeepSeek-V4-Pro-0813 | 1.32 USD | 3.96 USD | 1,048,576 | older than 30 days |
DeepSeek V4.1 Flash deepseek-ai/DeepSeek-V4.1-Flash | 0.300 USD | 1.20 USD | 1,048,576 | older than 30 days |
Rnj-1 Instruct essentialai/Rnj-1-Instruct | 0.150 USD | 0.150 USD | 32,768 | older than 30 days |
Llama 3.3 70B meta-llama/Llama-3.3-70B-Instruct-Turbo | 1.04 USD | 1.04 USD | 131,072 | older than 30 days |
Muse Spark Open meta-models/Muse-Spark-Open-816B-A42B | 1.25 USD | 4.25 USD | 1,048,576 | |
Kimi K3 moonshotai/Kimi-K3 | 3.00 USD | 15.00 USD | 1,048,576 | older than 30 days |
Nemotron 3.5 Super VL 120B A12B nvidia/NVIDIA-Nemotron-3.5-Super-VL | 0.150 USD | 0.500 USD | 262,144 | |
Nemotron 3 Ultra 550B A55B nvidia/nemotron-3-ultra-550b-a55b | 0.600 USD | 3.60 USD | 512,300 | older than 30 days |
GPT OSS 120B openai/gpt-oss-120b | 0.150 USD | 0.600 USD | 131,072 | older than 30 days |
Beam 1.0 501B A23B reflection/Beam-1.0-501B-A23B | 0.400 USD | 1.20 USD | 1,048,576 | |
Inkling thinkingmachines/Inkling | 1.00 USD | 4.05 USD | 524,288 | older than 30 days |
GLM-5 zai-org/GLM-5 | 1.00 USD | 3.20 USD | 202,752 | older than 30 days |
GLM-5.1 zai-org/GLM-5.1 | 1.40 USD | 4.40 USD | 202,752 | older than 30 days |
GLM-5.2 zai-org/GLM-5.2 | 1.40 USD | 4.40 USD | 1,048,575 | older than 30 days |
GLM-5.3 zai-org/GLM-5.3 | 1.40 USD | 4.40 USD | 1,048,576 | older than 30 days |
GLM-5.3-Flash zai-org/GLM-5.3-Flash | 0.150 USD | 0.500 USD | 1,048,575 | older than 30 days |
Sources of this page
- docs.together.ai/docs/inference/openai-compatibility, read
- docs.together.ai/docs/inference/chat/structured-outputs, read
- docs.together.ai/docs/inference/function-calling/overview, read
- docs.together.ai/docs/serverless/rate-limits, read
- www.together.ai/pricing, read
- docs.together.ai/docs/privacy-and-security, read
- models.dev/api.json, read
Paid links
No link in this directory is a paid link or an ad, and no listing is paid for. The order and the contents of every list come from the sources named on this page.