Rig score · nvidia
Nvidia GeForce RTX 3060 Ti (8GB)
Runs 57 of 155 models (37%)
Capable, 7-8B models run well.
Biggest it can run: Ornith 1.5 9B
- Grade
- C
- Runnable
- 57
- Total
- 155
- Coverage
- 37%
What Nvidia GeForce RTX 3060 Ti (8GB) can run
At 8 GB of VRAM, Nvidia GeForce RTX 3060 Ti (8GB) runs 57 of 155 tracked local models, 37% coverage that earns a C. The largest it handles is Ornith 1.5 9B at 9B parameters; anything bigger needs more memory or a lower quantization.
Only the 8 GB of VRAM drives speed: a model that spills into system RAM slows sharply. Keep the weights plus KV cache under VRAM and prefer Q4_K_M to leave headroom.
Top models on Nvidia GeForce RTX 3060 Ti (8GB)
FAQ
What local AI rig score does Nvidia GeForce RTX 3060 Ti (8GB) get?
Nvidia GeForce RTX 3060 Ti (8GB) scores C: it runs 57 of 155 tracked local LLMs (37%). The biggest it can run is Ornith 1.5 9B.
How big a model can Nvidia GeForce RTX 3060 Ti (8GB) run?
Nvidia GeForce RTX 3060 Ti (8GB) runs models up to Ornith 1.5 9B (9B parameters) at Q4_K_M. Speed depends on keeping the whole model inside VRAM.
Is Nvidia GeForce RTX 3060 Ti (8GB) good for running local LLMs?
Only the 8 GB of VRAM drives speed: a model that spills into system RAM slows sharply. Keep the weights plus KV cache under VRAM and prefer Q4_K_M to leave headroom.
Want your own? Check your rig on the homepage →
Score from coverage of 155 tracked models, estimated with our memory methodology.