Ollama
Self-hosted
Local inference engine. REST API, multi-model, Q4_K_M quantization.
MIT Free
Software & Tools
The software we use and recommend
17 Self-hosted
9 Cloud
18 Free
Local Inference
Engines that run models on your hardware
MLX
Self-hosted
Apple framework for Apple Silicon. 93% faster than CPU.
MIT Free
llama.cpp
Self-hosted
C++ inference for GGUF models. Ollama is built on this.
MIT Free
vLLM
Self-hosted
High-performance inference server with PagedAttention.
Apache 2.0 Free
Orchestration & Agents
Frameworks for building and managing AI agents
Claude Code
Cloud
Anthropic CLI for autonomous agents. Our primary system.
Proprietary API pay-per-use
LangChain
Self-hosted
Chain and agent framework for LLMs. Wide ecosystem.
MIT Free
CrewAI
Self-hosted
Multi-agent with roles, tasks, and delegation.
MIT Free
AutoGen
Self-hosted
Microsoft framework for multi-turn conversational agents.
MIT Free
Automation & Workflows
No-code and code-based automation platforms
n8n
Self-hosted
Workflow automation with 400+ integrations. Self-hosted or cloud.
Fair-code Free (self) / from EUR 20/mo
ComfyUI
Self-hosted
Visual workflow editor for image/video generation.
GPL-3.0 Free
RAG & Search
Retrieval and embedding systems for contextual AI
FAISS
Self-hosted
Vector search by Meta. Our primary RAG system.
MIT Free
ChromaDB
Self-hosted
Embedded vector database. Easy to use.
Apache 2.0 Free
Pinecone
Cloud
Cloud managed vector DB. Scalable.
Proprietary Free up to 100K / from USD 25/mo
Backend & APIs
Server frameworks and databases
FastAPI
Self-hosted
Python async framework. Our internal API runs on it.
MIT Free
SQLite
Self-hosted
Embedded database. Our primary DB (vorlux.db).
Public Domain Free
Astro
Self-hosted
Static framework for website. SSG with islands.
MIT Free
Networking & Security
VPN, remote management, and security
Tailscale
Self-hosted
Zero-trust mesh VPN. Remote management of deployments.
BSD Free (3 users) / from USD 6/user
WireGuard
Self-hosted
Modern VPN protocol. Tailscale is built on this.
GPL-2.0 Free
Cloud GPU & APIs
When you need more power than local hardware
RunPod
Cloud
Cloud GPU rental. A100 from USD 1.29/hr.
Proprietary From USD 1.29/hr
Anthropic API
Cloud
Claude Opus/Sonnet/Haiku via API.
Proprietary From USD 0.25/1M tok
OpenAI API
Cloud
GPT-4o, GPT-4o-mini via API.
Proprietary From USD 0.15/1M tok
HuggingFace
Self-hosted
Model hub, datasets, spaces. Our model source.
Apache 2.0 Free / Pro from USD 9/mo
GitHub Repos
Curated repositories
Best open-source repos for local AI deployments
open-webui/open-webui
60K+Full web UI for Ollama and other backends. Chat, RAG, multi-user.
UIRAGMulti-user
n8n-io/n8n
55K+Workflow automation with AI nodes. Self-hosted.
AutomationSelf-hosted
ComfyUI/ComfyUI
70K+Visual workflow editor for Stable Diffusion. Our standard for image generation.
Image GenWorkflows
ggerganov/whisper.cpp
36K+Ultra-fast local speech-to-text. Pure C++, runs on CPU.
AudioSTTEdge
AUTOMATIC1111/stable-diffusion-webui
145K+Stable Diffusion WebUI with extensions. Alternative to ComfyUI.
Image GenWebUI
chroma-core/chroma
16K+Vector database for RAG. Easy to deploy locally.
RAGVector DB
danny-avila/LibreChat
20K+Open source multi-provider chat. API Gateway for your team.
ChatMulti-model
huggingface/text-generation-inference
10K+HuggingFace inference server. Production-ready.
InferenceProduction
dagger/dagger
12K+Programmable CI/CD. Reproducible containers for AI deployments.
DevOpsCI/CD
Build with these tools
Free generators for Claude Code: agents, skills, MCP servers, plugins
Veredicto semanal
Get new guides before anyone else
Subscribe and we tell you when new guides, templates and workflows go up. One email a week, no spam.
Already published: 79 guides and 25 templates. All free, no signup.
Bonus: the EU AI Act checklist, ready to complete
Once a week No spam Unsubscribe anytime
The EU AI Act now applies: a checklist you can complete
Tell us what you want to run
Tell us what you want to run and on what budget. We will tell you which hardware you need, which model fits, and what to expect from it, before you spend anything.
First call free, 15 min Local-first: your data stays on your network Open tools and guides
79 free guides · 17 compliance templates