United States
Ollama
The most popular way to run local LLMs. One-command model pulls, GPU offload, and CPU/GPU split for models larger than your VRAM.
GPU acceleration
Yes
CPU-only
Possible
RAM offload
Yes
VRAM overhead
1 GB
Popular models to run in Ollama
Qwen2.5 32B
Qwen · 32.8B
Qwen2.5-Coder 32B
Qwen · 32.8B
Llama 3.1 8B
Llama · 8B
DeepSeek-R1 Distill Qwen 32B
DeepSeek · 32.8B
Qwen2.5 7B
Qwen · 7.6B
Qwen2.5-Coder 7B
Qwen · 7.6B
Llama 3.3 70B
Llama · 70.6B
Qwen2.5 14B
Qwen · 14.8B
DeepSeek-R1 Distill Qwen 14B
DeepSeek · 14.8B
DeepSeek-R1 Distill Qwen 7B
DeepSeek · 7.6B
DeepSeek-R1 Distill Llama 70B
DeepSeek · 70.6B
Qwen2.5 72B
Qwen · 72.7B