Skip to content
localmodel.run

Hardware guide · Granite

What hardware do you need to run Granite 4.2 8B?

Granite 4.2 8B needs about 6.5 GB to run at Q4_K_M, so the lightest hardware that runs it is Nvidia GeForce RTX 3060 Ti (8GB). 35 of 43 devices tested can run it.

Needs (Q4_K_M)
~6.5 GB
Devices that run it
35
Too small
8
Lightest that runs it
~7 GB
Recommended Q4_K_M
Apple M2 (16GB) Yes

Runs at Q4_K_M using ~6.5 GB of ~10.5 GB usable. You have room for Q8_0 for higher quality.

What kind of hardware runs Granite 4.2 8B

Of the 35 devices that run it, here is the split by hardware class.

11 discrete GPUs 13 Macs 2 laptops 9 phones

Hardware that runs Granite 4.2 8B

Ranked by usable memory, lightest first. Prices are approximate street prices for the device itself (a GPU is the card alone; a Mac is the whole machine). Tok/s is a bandwidth estimate; see methodology.

Compatible devices 35 total

Too small for Granite 4.2 8B

Apple M1 (8GB) 8GB RAM Laptop (CPU/iGPU only) Nvidia GeForce RTX 2060 (6GB) iPhone 15 Pro iPhone 16 iPhone 16 Pro Generic Android Phone (8GB RAM) iPhone 17

See the full Granite 4.2 8B memory breakdown, or compare it against other models.

Sources

Memory at Q4_K_M (6.5 GB = 4.98 GB weights + KV cache + overhead), Catalog updated 2026-10-05. See methodology.