Fits in 16 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.
Your VRAM
16 GB
Needs (est.)
13 GB
Quantization
FP8
Fits in 16 GB of VRAM (needs ~13 GB) — runs fully on the GPU at FP8.