Can a MSI GeForce RTX 3080 VENTUS 3X 10G OC run FLUX.1 dev (12B)?
Sort of — Runs with compromises
Too big for 10 GB of VRAM (needs ~13 GB), but it can run by offloading part of the model to system RAM — slower, and it uses your RAM. A smaller quantization may help.
Your VRAM
10 GB
Needs (est.)
13 GB
Quantization
FP8