Inkling Small

Facts

Released

2026-07-27 the day the repository was first published on Hugging Face Hugging Face, read 2026-09-24

Licence

apache-2.0 the licence the model card declares Hugging Face, read 2026-09-24

Open weights

Yes the weights are published in this Hugging Face repository Hugging Face, read 2026-09-24

Parameters

266.0 billion counted from the safetensors weight files Hugging Face, read 2026-09-24

Active parameters

1.7 billion estimate estimated from the expert counts and sizes in the configuration model configuration, read 2026-09-24

Knowledge cutoff

Unknown

Context window

• 1,048,576 tokens the context length OpenRouter lists OpenRouter, read 2026-09-24

Longest output

• 262,144 tokens the largest output OpenRouter's first provider allows OpenRouter, read 2026-09-24

Tool calling

• Yes OpenRouter lists tools among the supported parameters OpenRouter, read 2026-09-24

Structured output

• No OpenRouter lists no structured output parameter OpenRouter, read 2026-09-24

Reasoning controls

• Yes OpenRouter lists reasoning controls, with the efforts max, high, medium, low, minimal, none OpenRouter, read 2026-09-24

Inputs and outputs

text, image in, text out Hugging Face, read 2026-09-24

Good for

• Vision: Hugging Face files it under image-text-to-text Hugging Face, read 2026-09-24
• Reasoning: OpenRouter lists reasoning controls for it OpenRouter, read 2026-09-24

Prices

Run it on your own hardware

Weights are the sizes of the files a source lists, or an estimate from the parameter count where none does. Memory is an estimate: weights plus KV cache plus 512 MiB and 5 percent of the weights for runtime buffers. Check it against your hardware.

Start it with a local runtime

• Ollama

  ollama run hf.co/unsloth/Inkling-Small-GGUF:UD-IQ1_S

• LM Studio

  lms get unsloth/Inkling-Small-GGUF
  lms server start

• llama.cpp server

  llama-server -hf unsloth/Inkling-Small-GGUF:UD-IQ1_S --jinja

• vLLM

  vllm serve thinkingmachines/Inkling-Small

• SGLang

  sglang serve --model-path thinkingmachines/Inkling-Small --port 30000

Use it from your harness

Set up for Arcee with the model thinkingmachines/inkling-small. Each endpoint page has the same setup for its own address.

{
  "$schema": "https://opencode.ai/config.json",
  "provider": {
    "arcee": {
      "npm": "@ai-sdk/openai-compatible",
      "name": "Arcee",
      "options": {
        "baseURL": "https://api.arcee.ai/api/v1",
        "apiKey": "{env:ARCEE_API_KEY}"
      },
      "models": {
        "thinkingmachines/inkling-small": {
          "name": "Inkling Small",
          "limit": {
            "context": 1048576,
            "output": 262144
          }
        }
      }
    }
  }
}

{
  "providers": {
    "arcee": {
      "baseUrl": "https://api.arcee.ai/api/v1",
      "api": "openai-completions",
      "apiKey": "$ARCEE_API_KEY",
      "models": [
        {
          "id": "thinkingmachines/inkling-small"
        }
      ]
    }
  }
}

Other ways to reach it

• Baseten, model thinkingmachines/inkling-small
• DeepInfra, model thinkingmachines/Inkling-Small
• Hugging Face, model thinkingmachines/Inkling-Small
• Kilo Gateway, model thinkingmachines/inkling-small
• LLMTR, model thinkingmachines/inkling-small
• NanoGPT, model thinkingmachines/Inkling-Small
• OpenRouter, model thinkingmachines/inkling-small
• Pioneer, model thinkingmachines/inkling-small

Published results

These are results other people published. Baltor did not run them and does not rank models by them.

• Results the maker published on the model card published by thinkingmachines Hugging Face, read 2026-09-24
• Artificial Analysis Coding Index: 52.9 published by Artificial Analysis OpenRouter, read 2026-09-24