DeepSeek-V2-Lite

Facts

Released

2024-05-15 the day the repository was first published on Hugging Face Hugging Face, read 2026-09-24

Licence

other the licence the model card declares Hugging Face, read 2026-09-24

Open weights

Yes the weights are published in this Hugging Face repository Hugging Face, read 2026-09-24

Parameters

15.7 billion counted from the safetensors weight files Hugging Face, read 2026-09-24

Active parameters

2.7 billion estimate estimated from the expert counts and sizes in the configuration model configuration, read 2026-09-24

Knowledge cutoff

Unknown

Context window

• 163,840 tokens the maximum position embeddings in the model configuration model configuration, read 2026-09-24

Longest output

Unknown

Tool calling

• No the chat template in the tokenizer configuration has no place for tool definitions Hugging Face, read 2026-09-24

Structured output

Unknown

Reasoning controls

Unknown

Inputs and outputs

text in, text out Hugging Face, read 2026-09-24

Good for

No source names a use.

Prices

No source lists a price for this model. It may only run on your own hardware.

Run it on your own hardware

Weights are the sizes of the files a source lists, or an estimate from the parameter count where none does. Memory is an estimate: weights plus KV cache plus 512 MiB and 5 percent of the weights for runtime buffers. Check it against your hardware.

Start it with a local runtime

• Ollama

  ollama run hf.co/legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S

• LM Studio

  lms get legraphista/DeepSeek-V2-Lite-IMat-GGUF
  lms server start

• llama.cpp server

  llama-server -hf legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S --jinja

• vLLM

  vllm serve deepseek-ai/DeepSeek-V2-Lite

• SGLang

  sglang serve --model-path deepseek-ai/DeepSeek-V2-Lite --port 30000

Use it from your harness

Set up for Ollama with the model hf.co/legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S. Each endpoint page has the same setup for its own address.

{
  "$schema": "https://opencode.ai/config.json",
  "provider": {
    "ollama": {
      "npm": "@ai-sdk/openai-compatible",
      "name": "Ollama",
      "options": {
        "baseURL": "http://localhost:11434/v1"
      },
      "models": {
        "hf.co/legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S": {
          "name": "DeepSeek-V2-Lite"
        }
      }
    }
  }
}

{
  "providers": {
    "ollama": {
      "baseUrl": "http://localhost:11434/v1",
      "api": "openai-completions",
      "apiKey": "ollama",
      "models": [
        {
          "id": "hf.co/legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S"
        }
      ]
    }
  }
}

codex --oss --local-provider ollama -m hf.co/legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S

export ANTHROPIC_BASE_URL="http://localhost:11434"
export ANTHROPIC_AUTH_TOKEN="ollama"
export ANTHROPIC_MODEL="hf.co/legraphista/DeepSeek-V2-Lite-IMat-GGUF:Q4_K_S"
claude

Published results

These are results other people published. Baltor did not run them and does not rank models by them.

• Results the maker published on the model card published by deepseek-ai Hugging Face, read 2026-09-24