CUSTOMYOURPC
Log In | Register US United States Change region
Toggle dark mode
Can I run Qwen2.5 72B

Can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run Qwen2.5 72B?

Not really — Not recommended

Needs ~46 GB and won't fit comfortably in 6 GB VRAM + 32 GB RAM at a usable speed. A larger-VRAM GPU or a smaller model is the way to run this.

Your VRAM
6 GB
Needs (est.)
46 GB
Quantization
Q4_K_M
See a full build for Qwen2.5 72B What else can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run?