Text model · Granite
Can I run Granite 4.0 H Small? Pick your device.
Granite 4.0 H Small is a 32B MoE (9B active) model. At Q4_K_M the weights are ~18.23 GB; with KV cache and runtime overhead, budget ~20.4 GB. Select your hardware below to see the full compatibility breakdown.
Apple Silicon Macs
- Apple M1 (8GB) No
- Apple M2 (16GB) No
- Apple M4 (16GB) No
- Apple M5 (16GB) No
- Apple M3 Pro (18GB) No
- Apple M4 (24GB) No
- Apple M4 Pro (24GB) No
- Apple M5 (32GB) Tight
- Apple M4 Pro (48GB) Yes
- Apple M5 Pro (48GB) Yes
- Apple M4 Max (64GB) Yes
- Apple M4 Max (128GB) Yes
- Apple M5 Max (128GB) Yes
- Apple M3 Ultra (256GB) Yes
RAM-only laptops
iPhone & iPad
Android
NVIDIA GPUs
AMD GPUs
Memory figures are estimates. See methodology.