audio model · musicgen · Windows
Can I run MusicGen large on Nvidia GeForce RTX 4060 Ti (16GB)?
Needs ~20 GB at fp32, but only ~15 GB is usable on Nvidia GeForce RTX 4060 Ti (16GB).
Needs ~20 GB at fp32, but only ~15 GB is usable on Nvidia GeForce RTX 4060 Ti (16GB).
- Peak memory
- ~20 GB
- Usable on device
- ~15 GB
- Device memory
- 16 GB
- Quant
- fp32
- Type
- Music generation
- Parameters
- 3.3B
- Peak memory
- ~20 GB at fp32
- License
- CC-BY-NC-4.0
- Memory
- 16 GB vram
- Usable for weights
- ~15 GB
- Best runtime
- Ollama (CUDA) / llama.cpp CUDA
What you can run instead
Run MusicGen large on other hardware
FAQ
Can Nvidia GeForce RTX 4060 Ti (16GB) run MusicGen large?
Needs ~20 GB at fp32, but only ~15 GB is usable on Nvidia GeForce RTX 4060 Ti (16GB).
How much memory does MusicGen large need?
Nvidia GeForce RTX 4060 Ti (16GB) does not have enough memory. At fp32 the realistic peak is ~20 GB of memory.
What do I use to run MusicGen large locally?
MusicGen large runs in AudioCraft or HF Transformers. It needs a GPU.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.