Can a GeForce RTX 3090 Founders Edition run Llama 3.3 70B?

Sort of — Runs with compromises

Too big for 24 GB of VRAM (needs ~45 GB), but it can run by offloading part of the model to system RAM — slower, and it uses your RAM. A smaller quantization may help.

Your VRAM