Log In | Register

United States Change region

Toggle dark mode

Can I run Llama 3.2 3B

Can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run Llama 3.2 3B?

Yes — Runs well

Fits in 6 GB of VRAM (needs ~4 GB) — runs fully on the GPU at Q4_K_M.

Your VRAM

6 GB

Needs (est.)

4 GB

Quantization

Q4_K_M

See a full build for Llama 3.2 3B What else can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run?