Fits in 20 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.
Your VRAM
20 GB
Needs (est.)
13 GB
Quantization
FP8
Fits in 20 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.