audio model · musicgen · Windows
Can I run MusicGen large on Nvidia GeForce RTX 4080 (16GB)?
Needs ~20 GB at fp32, but only ~15 GB is usable on Nvidia GeForce RTX 4080 (16GB).
Needs ~20 GB at fp32, but only ~15 GB is usable on Nvidia GeForce RTX 4080 (16GB).
- Peak memory
- ~20 GB
- Usable on device
- ~15 GB
- Device memory
- 16 GB
- Quant
- fp32
- Type
- Music generation
- Parameters
- 3.3B
- Peak memory
- ~20 GB at fp32
- License
- CC-BY-NC-4.0
- Memory
- 16 GB vram
- Usable for weights
- ~15 GB
- Best runtime
- vLLM (Linux) / Ollama (CUDA)
What you can run instead
Run MusicGen large on other hardware
FAQ
Can Nvidia GeForce RTX 4080 (16GB) run MusicGen large?
Needs ~20 GB at fp32, but only ~15 GB is usable on Nvidia GeForce RTX 4080 (16GB).
How much memory does MusicGen large need?
Nvidia GeForce RTX 4080 (16GB) does not have enough memory. At fp32 the realistic peak is ~20 GB of memory.
What do I use to run MusicGen large locally?
MusicGen large runs in AudioCraft or HF Transformers. It needs a GPU.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.