Text model · llama
Llama 3.2 1B requirements
llama family · 1B params · released Sep 2024 · 59.5M Ollama pulls · LMArena Elo 1110. Minimum to run at Q4_K_M: Apple M1 (8GB).
Quantization sizes
| Quantization | Size on disk |
|---|---|
| Q2_K | 0.4 GB est |
| Q3_K_M | 0.5 GB est |
| Q4_K_M (default) | 0.81 GB |
| Q5_K_M | 0.7 GB est |
| Q6_K | 0.8 GB est |
| Q8_0 | 1.32 GB |
| FP16 | 2 GB est |
Lower quant = smaller and faster, slightly lower quality. Q4_K_M is the common default.
Run it
ollama run llama3.2:1b llama-cli -hf unsloth/Llama-3.2-1B-Instruct-GGUF:Q4_K_M lms get unsloth/Llama-3.2-1B-Instruct-GGUF Which devices can run Llama 3.2 1B?
Apple Silicon Macs
RAM-only laptops
iPhone & iPad
Android
NVIDIA GPUs
AMD GPUs
FAQ
How much VRAM or RAM does Llama 3.2 1B need?
At Q4_K_M, Llama 3.2 1B needs about 1.8 GB (weights ~0.81 GB + KV cache + overhead) at a 4k context. At Q8_0 budget ~2.3 GB.
Can Llama 3.2 1B run on a laptop?
Yes, Llama 3.2 1B fits on a 16 GB machine at Q4_K_M and runs on Apple Silicon or a 12 GB+ GPU comfortably.
Can I use Llama 3.2 1B commercially?
Conditionally. Llama 3.2 Community License: free under 700M MAU.
Released September 25, 2024. Smallest Llama model for edge/on-device use. Ollama tag shows 1.3GB (Q8_0 equivalent default). HF unsloth confirms Q4_K_M at 808MB (~0.81GB) and Q8_0 at 1.32GB.
Sources
Memory figures are estimates. See methodology.