Log In | Register

United States Change region

Toggle dark mode

Can I run Qwen2.5-Coder 7B

Can a MSI GeForce RTX 3090 GAMING X TRIO 24G run Qwen2.5-Coder 7B?

Yes — Runs well

Fits in 24 GB of VRAM (needs ~6 GB) — runs fully on the GPU at Q4_K_M.

Your VRAM

24 GB

Needs (est.)

6 GB

Quantization

Q4_K_M

See a full build for Qwen2.5-Coder 7B What else can a MSI GeForce RTX 3090 GAMING X TRIO 24G run?