Fits in 24 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.
Your VRAM
24 GB
Needs (est.)
13 GB
Quantization
FP8
Fits in 24 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.