Fits in 32 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.
Your VRAM
32 GB
Needs (est.)
13 GB
Quantization
FP8
Fits in 32 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.