53 open-source models selected for local deployment. Each with its use case, the memory it needs and how to install it.
Source: Hugging Face and Ollama. Sizes checked on 6 October 2026.
53 models 8 categories 20 machines compared
Pick a model and a quantisation to see which machines it fits.
Pick a model, a quantisation and a context. The bars show which machines it fits.
Estimated memory needed
Weights = parameters × bits per weight ÷ 8 (Q4_0 4.5 · Q4_K_M 4.85 · Q8_0 8.5 · FP16 16). Cache = MB per token × context tokens. Runtime = 1.5 GB.
Measured with ollama ps on our GB10, real use comes in 1.4 to 1.6 GB below this figure: we would rather you have memory to spare than run short. From each machine we also take off the share the operating system keeps.
Estimated speed: –
From least to most memory. Open a machine for its spec sheet and where to buy it.
Tip:
Get this analysis by email
Analysis saved. We will email it to you.
Next step: Hardware selector ROI calculator Grants
53 models
Click a model for details
Best community fine-tune for agentic use. Excellent at following complex system prompts and using tools.
Jetson Orin Nano 8GB (Q4) or Mac Mini M4
ollama pull hermes3:8b Fine-tuned on financial data. Understands financial terminology, ratios, and market concepts.
Mac Mini M4 24GB (Q8) or RTX 4060 Ti (Q4)
ollama pull finance-llm:13b Uncensored fine-tune, no alignment filtering. Useful for creative tasks, red-teaming, research.
Jetson Orin Nano 8GB (Q4) or any device
ollama pull dolphin-llama3:8b Meta's safety classifier. Run alongside any model to filter harmful content. Essential for production deployments.
Jetson Orin Nano 8GB (Q4) or any device
ollama pull llama-guard3:8b Specialized in correcting OCR errors from historical documents. Perfect for digitization projects. Apache 2.0.
Any device (124M parameters)
ollama pull ocronos No models found
Select 2-3 models for a side-by-side comparison.
For jobs that need a bigger model than your machine holds, this is what the API costs. We only publish prices we have checked on each provider's official page.
| Model | Provider | Input | Output | Context |
|---|---|---|---|---|
| GPT-5 | OpenAI | $1.25 | $10.00 | 400K |
| GPT-5 Mini | OpenAI | $0.25 | $2.00 | 400K |
| Claude Sonnet 5 | Anthropic | $2.00 | $10.00 | 200K |
| Claude Haiku 4.5 | Anthropic | $1.00 | $5.00 | 200K |
Sources: OpenAI · Anthropic. To compare with what it costs locally, use the cost calculator.
Subscribe and we tell you when new guides, templates and workflows go up. One email a week, no spam.
Already published: 79 guides and 25 templates. All free, no signup.
Tell us what you want to run and on what budget. We will tell you which hardware you need, which model fits, and what to expect from it, before you spend anything.
79 free guides · 17 compliance templates
Your question, with your email; we answer it ourselves
Your question and your email:
What brings you here?