audio model · bark · Windows
BK Can I run Bark on Nvidia GeForce RTX 4090 (24GB)?
Yes. Bark runs on Nvidia GeForce RTX 4090 (24GB) at fp32 (~5 GB of ~23 GB usable).
Runs at fp32 using ~5 GB of ~23 GB usable.
- Peak memory
- ~5 GB
- Usable on device
- ~23 GB
- Device memory
- 24 GB
- Quant
- fp32
How to run it
Use HF Transformers or suno-ai/bark at fp32. It is light enough to run on CPU; a GPU just makes it faster.
- Type
- Text to speech (and sound effects)
- Parameters
- 900M
- Peak memory
- ~5 GB at fp32
- License
- MIT
- Memory
- 24 GB vram
- Usable for weights
- ~23 GB
- Best runtime
- vLLM (Linux) / Ollama (CUDA)
You could also run
Run Bark on other hardware
FAQ
Can Nvidia GeForce RTX 4090 (24GB) run Bark?
Yes. Bark runs on Nvidia GeForce RTX 4090 (24GB) at fp32 (~5 GB of ~23 GB usable).
How much memory does Bark need?
Nvidia GeForce RTX 4090 (24GB) has room to spare. At fp32 the realistic peak is ~5 GB of memory.
What do I use to run Bark locally?
Bark runs in HF Transformers or suno-ai/bark (among others). It runs on CPU, so no GPU is required.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.