audio model · musicgen · Windows
Can I run MusicGen large on Nvidia GeForce RTX 4090 (24GB)?
Yes. MusicGen large runs on Nvidia GeForce RTX 4090 (24GB) at fp32 (~20 GB of ~23 GB usable).
Runs at fp32 using ~20 GB of ~23 GB usable.
- Peak memory
- ~20 GB
- Usable on device
- ~23 GB
- Device memory
- 24 GB
- Quant
- fp32
How to run it
Use AudioCraft or HF Transformers at fp32. It loads as a single model and runs on a GPU.
- Type
- Music generation
- Parameters
- 3.3B
- Peak memory
- ~20 GB at fp32
- License
- CC-BY-NC-4.0
- Memory
- 24 GB vram
- Usable for weights
- ~23 GB
- Best runtime
- vLLM (Linux) / Ollama (CUDA)
You could also run
Run MusicGen large on other hardware
FAQ
Can Nvidia GeForce RTX 4090 (24GB) run MusicGen large?
Yes. MusicGen large runs on Nvidia GeForce RTX 4090 (24GB) at fp32 (~20 GB of ~23 GB usable).
How much memory does MusicGen large need?
Nvidia GeForce RTX 4090 (24GB) has room to spare. At fp32 the realistic peak is ~20 GB of memory.
What do I use to run MusicGen large locally?
MusicGen large runs in AudioCraft or HF Transformers. It needs a GPU.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.