Can a MSI GeForce RTX 2080 TI VENTUS 11G OC run Llama 3.3 70B?
Not really — Not recommended
Needs ~45 GB and won't fit comfortably in 11 GB VRAM + 32 GB RAM at a usable speed. A larger-VRAM GPU or a smaller model is the way to run this.
Your VRAM
11 GB
Needs (est.)
45 GB
Quantization
Q4_K_M