audio model · whisper · macOS
Can I run Whisper large-v3-turbo on Apple M3 Ultra (256GB)?
Yes. Whisper large-v3-turbo runs on Apple M3 Ultra (256GB) at int8 (~1.5 GB of ~192 GB usable).
Runs at int8 using ~1.5 GB of ~192 GB usable.
- Peak memory
- ~1.5 GB
- Usable on device
- ~192 GB
- Device memory
- 256 GB
- Quant
- int8
How to run it
Use whisper.cpp or faster-whisper at int8. It is light enough to run on CPU; a GPU just makes it faster.
- Type
- Speech to text
- Parameters
- 809M
- Peak memory
- ~1.5 GB at int8
- License
- MIT
- Memory
- 256 GB unified
- Usable for weights
- ~192 GB
- Best runtime
- MLX direct / Ollama (MLX backend)
You could also run
Run Whisper large-v3-turbo on other hardware
FAQ
Can Apple M3 Ultra (256GB) run Whisper large-v3-turbo?
Yes. Whisper large-v3-turbo runs on Apple M3 Ultra (256GB) at int8 (~1.5 GB of ~192 GB usable).
How much memory does Whisper large-v3-turbo need?
Apple M3 Ultra (256GB) has room to spare. At int8 the realistic peak is ~1.5 GB of memory.
What do I use to run Whisper large-v3-turbo locally?
Whisper large-v3-turbo runs in whisper.cpp or faster-whisper (among others). It runs on CPU, so no GPU is required.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.