Log In | Register

United States Change region

Toggle dark mode

Can I run Phi-3 Mini (3.8B)

Can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run Phi-3 Mini (3.8B)?

Yes — Runs well

Fits in 6 GB of VRAM (needs ~5 GB) — runs fully on the GPU at Q4_K_M.

Your VRAM

6 GB

Needs (est.)

5 GB

Quantization

Q4_K_M

See a full build for Phi-3 Mini (3.8B) What else can a Asus ASUS TUF Gaming GeForce RTX 2060 6GB Edition 4K VR Ready HDMI 2.0b DP 1.4 Auto Extreme Graphics Card (TUF-RTX2060-O6G-GAMING) run?