audio model · musicgen · Windows
Can I run MusicGen medium on Nvidia GeForce RTX 4060 Ti (16GB)?
Yes. MusicGen medium runs on Nvidia GeForce RTX 4060 Ti (16GB) at fp32 (~14 GB of ~15 GB usable).
Fits at fp32 (~14 GB of ~15 GB usable) but with little headroom; close other apps.
- Peak memory
- ~14 GB
- Usable on device
- ~15 GB
- Device memory
- 16 GB
- Quant
- fp32
How to run it
Use AudioCraft or HF Transformers at fp32. It loads as a single model and runs on a GPU.
- Type
- Music generation
- Parameters
- 1.5B
- Peak memory
- ~14 GB at fp32
- License
- CC-BY-NC-4.0
- Memory
- 16 GB vram
- Usable for weights
- ~15 GB
- Best runtime
- Ollama (CUDA) / llama.cpp CUDA
You could also run
Run MusicGen medium on other hardware
FAQ
Can Nvidia GeForce RTX 4060 Ti (16GB) run MusicGen medium?
Yes. MusicGen medium runs on Nvidia GeForce RTX 4060 Ti (16GB) at fp32 (~14 GB of ~15 GB usable).
How much memory does MusicGen medium need?
It is a tight fit on Nvidia GeForce RTX 4060 Ti (16GB). At fp32 the realistic peak is ~14 GB of memory.
What do I use to run MusicGen medium locally?
MusicGen medium runs in AudioCraft or HF Transformers. It needs a GPU.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.