Skip to content
localmodel.run

Text model · Qwen3

Qwen3 0.6B requirements

Qwen3 family · 0.6B params · released 2025-04-29 · 23M Ollama pulls. Minimum to run at Q4_K_M: Apple M1 (8GB).

LicenseApache-2.0· Commercial OK↓ 17.4M/mo♥ 1.3Kon HuggingFace
Q4_K_M
0.48 GB
Q8_0
0.8 GB
Total @ Q4 (4k)
~1.5 GB
Context
32 k

Quantization sizes

GGUF quantson disk
QuantizationSize on disk
Q2_K0.3 GB est
Q3_K_M0.3 GB est
Q4_K_M (default)0.48 GB
Q5_K_M0.4 GB est
Q6_K0.5 GB est
Q8_00.8 GB
FP161.2 GB est

Lower quant = smaller and faster, slightly lower quality. Q4_K_M is the common default.

Run it

Ollama
$ ollama run qwen3:0.6b
llama.cpp
$ llama-cli -hf bartowski/Qwen_Qwen3-0.6B-GGUF:Q4_K_M
LM Studio
$ lms get bartowski/Qwen_Qwen3-0.6B-GGUF

Which devices can run Qwen3 0.6B?

FAQ

How much VRAM or RAM does Qwen3 0.6B need?

At Q4_K_M, Qwen3 0.6B needs about 1.5 GB (weights ~0.48 GB + KV cache + overhead) at a 4k context. At Q8_0 budget ~1.8 GB.

Can Qwen3 0.6B run on a laptop?

Yes, Qwen3 0.6B fits on a 16 GB machine at Q4_K_M and runs on Apple Silicon or a 12 GB+ GPU comfortably.

Can I use Qwen3 0.6B commercially?

Yes. Qwen3 0.6B is licensed Apache-2.0, which permits commercial use.

Smallest Qwen3 dense model. Supports thinking/non-thinking dual mode, 32K native context (extendable to 128K via YaRN). Designed for extreme edge and on-device use.

Sources

Memory figures are estimates. See methodology.