Can a MSI GeForce RTX 3080 RTX 3080 SUPRIM X 10G run Qwen2.5 14B?

Sort of — Runs with compromises

Too big for 10 GB of VRAM (needs ~12 GB), but it can run by offloading part of the model to system RAM — slower, and it uses your RAM. A smaller quantization may help.

Your VRAM