audio model · musicgen · Windows
Can I run MusicGen large on Nvidia GeForce RTX 3060 (12GB)?
Needs ~20 GB at fp32, but only ~11 GB is usable on Nvidia GeForce RTX 3060 (12GB).
Needs ~20 GB at fp32, but only ~11 GB is usable on Nvidia GeForce RTX 3060 (12GB).
- Peak memory
- ~20 GB
- Usable on device
- ~11 GB
- Device memory
- 12 GB
- Quant
- fp32
- Type
- Music generation
- Parameters
- 3.3B
- Peak memory
- ~20 GB at fp32
- License
- CC-BY-NC-4.0
- Memory
- 12 GB vram
- Usable for weights
- ~11 GB
- Best runtime
- Ollama (CUDA) / llama.cpp CUDA
What you can run instead
Run MusicGen large on other hardware
FAQ
Can Nvidia GeForce RTX 3060 (12GB) run MusicGen large?
Needs ~20 GB at fp32, but only ~11 GB is usable on Nvidia GeForce RTX 3060 (12GB).
How much memory does MusicGen large need?
Nvidia GeForce RTX 3060 (12GB) does not have enough memory. At fp32 the realistic peak is ~20 GB of memory.
What do I use to run MusicGen large locally?
MusicGen large runs in AudioCraft or HF Transformers. It needs a GPU.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.