United States
Can I run Qwen2.5-Coder 7B?
Which graphics cards run Qwen2.5-Coder 7B locally, and how. Verdicts assume the Q4_K_M quantization at up to 8K context with 32 GB system RAM.
| Graphics card | VRAM | Verdict | |
|---|---|---|---|
| GeForce RTX 5090 Founders Edition | 32 GB | Runs well | Details → |
| GeForce RTX 3090 Founders Edition | 24 GB | Runs well | Details → |
| Sapphire NITRO+ Radeon RX 7900 XTX | 24 GB | Runs well | Details → |
| ASUS ROG Strix GeForce RTX 4090 OC | 24 GB | Runs well | Details → |
| Gigabyte GAMING OC Radeon RX 7600 XT | 16 GB | Runs well | Details → |
| GeForce RTX 4060 Ti 16GB | 16 GB | Runs well | Details → |
| ASUS TUF GeForce RTX 4070 Ti SUPER OC | 16 GB | Runs well | Details → |
| MSI GeForce RTX 4080 SUPER GAMING X SLIM | 16 GB | Runs well | Details → |
| MSI GeForce RTX 3060 Ventus 2X 12G | 12 GB | Runs well | Details → |
| ASUS PRIME GeForce RTX 4070 OC | 12 GB | Runs well | Details → |
| ASRock Challenger D Radeon RX 6600 | 8 GB | Runs well | Details → |
| MSI GeForce RTX 4060 VENTUS 2X BLACK OC | 8 GB | Runs well | Details → |
| MSI VENTUS 2X BLACK OC | GB | Not recommended | Details → |
| Sapphire PULSE Radeon RX 9070 XT | GB | Not recommended | Details → |
| Asus PRIME OC GeForce RTX 5070 | GB | Not recommended | Details → |