audio model · musicgen · Windows
Can I run MusicGen medium on Nvidia GeForce RTX 4070 (12GB)?
Needs ~14 GB at fp32, but only ~11 GB is usable on Nvidia GeForce RTX 4070 (12GB).
Needs ~14 GB at fp32, but only ~11 GB is usable on Nvidia GeForce RTX 4070 (12GB).
- Peak memory
- ~14 GB
- Usable on device
- ~11 GB
- Device memory
- 12 GB
- Quant
- fp32
- Type
- Music generation
- Parameters
- 1.5B
- Peak memory
- ~14 GB at fp32
- License
- CC-BY-NC-4.0
- Memory
- 12 GB vram
- Usable for weights
- ~11 GB
- Best runtime
- Ollama (CUDA) / vLLM (Linux)
What you can run instead
Run MusicGen medium on other hardware
FAQ
Can Nvidia GeForce RTX 4070 (12GB) run MusicGen medium?
Needs ~14 GB at fp32, but only ~11 GB is usable on Nvidia GeForce RTX 4070 (12GB).
How much memory does MusicGen medium need?
Nvidia GeForce RTX 4070 (12GB) does not have enough memory. At fp32 the realistic peak is ~14 GB of memory.
What do I use to run MusicGen medium locally?
MusicGen medium runs in AudioCraft or HF Transformers. It needs a GPU.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.