CUSTOMYOURPC
Log In | Register US United States Change region
Toggle dark mode
Can I run Llama 3.3 70B

Can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run Llama 3.3 70B?

Not really — Not recommended

Needs ~45 GB and won't fit comfortably in 6 GB VRAM + 32 GB RAM at a usable speed. A larger-VRAM GPU or a smaller model is the way to run this.

Your VRAM
6 GB
Needs (est.)
45 GB
Quantization
Q4_K_M
See a full build for Llama 3.3 70B What else can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run?