Text model · Qwen3
Qwen3 32B requirements
Qwen3 family · 32B params · released Apr 2025 · 23M Ollama pulls · LMArena Elo 1347. Minimum to run at Q4_K_M: Nvidia GeForce RTX 4090 (24GB).
Quantization sizes
| Quantization | Size on disk |
|---|---|
| Q2_K | 13.4 GB est |
| Q3_K_M | 15.6 GB est |
| Q4_K_M (default) | 19.8 GB |
| Q5_K_M | 22.8 GB est |
| Q6_K | 26.2 GB est |
| Q8_0 | 34.8 GB |
| FP16 | 66 GB |
Lower quant = smaller and faster, slightly lower quality. Q4_K_M is the common default.
Run it
ollama run qwen3:32b llama-cli -hf Qwen/Qwen3-32B-GGUF:Q4_K_M lms get Qwen/Qwen3-32B-GGUF Which devices can run Qwen3 32B?
Apple Silicon Macs
RAM-only laptops
iPhone & iPad
Android
NVIDIA GPUs
FAQ
How much VRAM or RAM does Qwen3 32B need?
At Q4_K_M, Qwen3 32B needs about 22 GB (weights ~19.8 GB + KV cache + overhead) at a 4k context. At Q8_0 budget ~37 GB.
Can Qwen3 32B run on a laptop?
Qwen3 32B is large; you need a 24 GB+ GPU or a 32-48 GB Mac at Q4_K_M.
Can I use Qwen3 32B commercially?
Yes. Qwen3 32B is licensed Apache-2.0, which permits commercial use.
Official Qwen/Qwen3-32B-GGUF HF repo lists Q4_K_M=19.8GB, Q8_0=34.8GB. Cross-checked with Ollama tags page (20GB rounded). Context 32K native, 128K via YaRN.
Sources
Memory figures are estimates. See methodology.