video model · cogvideox · Windows
CV Can I run CogVideoX-5B on Nvidia GeForce RTX 3090 (24GB)?
Yes. CogVideoX-5B runs on Nvidia GeForce RTX 3090 (24GB) at INT8 / fp8 (~16 GB of ~23 GB usable).
Runs at INT8 / fp8 using ~16 GB of ~23 GB usable.
- Peak VRAM
- ~16 GB
- Usable on device
- ~23 GB
- Device memory
- 24 GB
- Quant
- INT8 / fp8
How to run it
Use Diffusers or ComfyUI at INT8 / fp8. The big text encoder is loaded to encode your prompt, then offloaded before generation, which is why peak VRAM stays near the backbone size rather than the sum of every file.
- Type
- video (DIT)
- Parameters
- 5B
- Peak VRAM
- ~16 GB at INT8 / fp8
- Resolution
- 720×480
- License
- CogVideoX License
- Memory
- 24 GB vram
- Usable for weights
- ~23 GB
- Best runtime
- vLLM (Linux) / Ollama (CUDA)
You could also run
Run CogVideoX-5B on other hardware
FAQ
Can Nvidia GeForce RTX 3090 (24GB) run CogVideoX-5B?
Yes. CogVideoX-5B runs on Nvidia GeForce RTX 3090 (24GB) at INT8 / fp8 (~16 GB of ~23 GB usable).
How much VRAM does CogVideoX-5B need?
Nvidia GeForce RTX 3090 (24GB) has room to spare. At INT8 / fp8 the realistic peak is ~16 GB of VRAM, versus ~26 GB with every component kept resident (no offload). With aggressive CPU offload it drops to ~5 GB, much slower.
What do I use to run CogVideoX-5B locally?
CogVideoX-5B runs in Diffusers or ComfyUI. It loads as a video diffusion checkpoint plus its text encoder and VAE, not a single chat command.
Sources
VRAM figures are sourced peak-usage anchors at the noted quant, validated 2026-06-15. See methodology.