Topic
AI & LLMs
Models you can run on your own hardware, prompt patterns that ship, agent frameworks that don't catch fire, and the awkward questions nobody answers in the breathless launch posts. Ollama, vLLM, llama.cpp, LocalAI, plus the quieter stuff — embeddings, RAG, evals, and figuring out when the cloud API is actually the right answer. If you'd rather understand the trade-offs than chase benchmarks, you'll feel at home here.
119 articles in this topic.
Featured posts
-
Blender MCP vs Headless bpy Scripts
Blender MCP is great for building one model with an agent watching screenshots. Headless bpy scripts win for batches, parallel agents, and automated checks.
14 min read -
Dify vs Open WebUI: Chat or App Builder?
Dify and Open WebUI both front your local LLMs, but they solve different problems. Compare footprint, RAG, auth, APIs and licenses, and see how to run both.
13 min read -
Agent Memory Without a Vector DB
Give a local LLM agent long-term memory with Markdown files or SQLite FTS5. Working code, token math, and the point where you finally need embeddings.
15 min read -
Local LLM JSON Output That Doesn't Lie
Constrained decoding makes local LLMs emit valid JSON in llama.cpp, Ollama, and vLLM. It guarantees syntax, not truth. Working curl, Pydantic, and retry code.
13 min read -
Crawl4AI: Feed Your RAG From the Web
Crawl a docs site to clean markdown with Crawl4AI, embed it with Ollama, store it in Qdrant, and query it. A working local RAG ingest pipeline, with politeness.
13 min read -
Train a Tiny GPT, Part 5: Fine-Tuning
A 5.8M-parameter GPT scores 1.626 bits per byte on Holmes. Gemma 4 E4B scores 0.953 untrained, and a 34-minute QLoRA run on an 8 GB GPU gets it to 0.865.
17 min read
All AI & LLMs articles
- Blender MCP vs Headless bpy Scripts
- Dify vs Open WebUI: Chat or App Builder?
- Agent Memory Without a Vector DB
- Local LLM JSON Output That Doesn't Lie
- Crawl4AI: Feed Your RAG From the Web
- Train a Tiny GPT, Part 5: Fine-Tuning
- Train a Tiny GPT, Part 4: Inference
- Train a Tiny GPT, Part 3: Training
- gVisor vs Firecracker vs Kata for Agents
- Train a Tiny GPT, Part 2: Attention
- Train a Tiny GPT, Part 1: Tokenizers
- Clef vs Jev: Cloudflare's 4x Tie
- Prompt Injection vs Your Coding Agent
- Batch Inference: One Model, 100 Users
- The Update That Broke Confidence
- Docker MCP Toolkit: Trust the Sandbox?
- Jev vs Von vs SemIf: Real Numbers
- NetAlertX MCP: One Token, Twelve Tools
- Skeleton Key MCP vs One Token Per Box
- Jev Retagged 840 Posts For 26 Cents
- Proxmox MCP: Read-Only Beats Root
- Home Assistant MCP: Server and Client
- Komodo MCP vs the Docker Socket
- Nano Banana Is Eating Its Own Images
- Your Coding Agent Can't Draw
- Aider vs Continue: Two Modes of Terminal AI Coding
- Docker Ate 215GB in a Week
- Continue.dev + Ollama: Local Code Assistant for Cheap
- Anubis: Anti-AI-Crawler Proof-of-Work
- pgvector for Local Embeddings
- What Is an AI Harness?
- Multiple Claude Code Accounts, One Config
- The Free Tier Rug Pull
- Real-ESRGAN & Upscaling Tools
- ControlNet & LoRA: Advanced Image Control
- API vs Self-Hosted LLMs: The Real Cost
- Free AI Image Gen vs Your Own GPU
- RAG Beyond Vector Search: BM25, Hybrid, Re-ranking
- How to Stretch a Free LLM Tier
- The Free AI Stack: What $0 Gets You
- Agentic Browsers: Browser-Use & Skyvern Reviewed
- Local Voice Assistant: Whisper + Piper + Home Assistant
- Your Agent Doesn't Need a Shell
- Llamafile: Single-Binary LLMs That Actually Just Run
- DeepSeek V4 Flash: 28 Cents a Million
- Where Should Your Coding Agent Run?
- DIY Perplexity: SearXNG + Local LLM = Private Web Search
- Local Coding Agents Need Less Context
- LM Studio vs Jan vs GPT4All: Desktop LLM Clients
- RAGAS: Evaluating RAG Without Vibes
- KV Cache Quantization: Free LLM Context, Almost
- Aider & Cline: Terminal AI Coding That Actually Ships
- Mixture of Experts (MoE) for Self-Hosters, Demystified
- Python Libraries Worth Your Time in 2026
- Speculative Decoding: Faster LLMs With a Tiny Sidekick
- Karakeep: Self-Hosted Bookmarks With AI Tagging
- Stop Feeding the AI Your Whole Repo
- RTK vs snip vs lean-ctx: Token Killers
- Hailo-8 vs Coral: AI Accelerators for the Edge
- AI Swarm Audited My 840-Post Blog
- Used GPU Buying Guide for Home Lab LLMs
- Claude Code in a Homelab Workflow
- Self-Host a Local AI Coding Workhorse
- Give Your AI Agent a Cheap Intern
- Claude Code + SearXNG: Private Web Search
- Dify: Visual Agent Workflows
- OpenRouter vs LiteLLM
- Function Calling in Local LLMs
- Gemma 4 vs Qwen3.6
- AnythingLLM as Knowledge Base
- Local Vision LLMs Worth Running in 2026
- MCP Servers: Tools for LLMs
- RAG Evaluation with Ragas
- LLM Distillation Explained
- GPU Passthrough on Proxmox: Run LLMs in a VM
- Open WebUI Tools, Functions and Pipelines Explained
- Self-Supervised Learning Explained
- Continue.dev vs Cody vs Tabby: AI Code Help Without the Cloud
- Qdrant vs Weaviate vs Chroma: Vector DB Showdown
- LangChain vs LlamaIndex: RAG Framework Showdown
- Beyond RAG: When a Virtual Filesystem Works Better
- Running Gemma 4 Locally with Ollama
- 1-Bit LLMs: The Quantization Endgame
- AMD Lemonade: Local LLM Serving for AMD GPUs
- When to Use Structured Output (JSON Mode) in LLMs
- Using AI to Find Security Bugs in Your Code
- LLM Temperature and top_p Explained Without the Math
- GPU Memory Math: Will This Model Actually Fit?
- LLM Backends: vLLM vs llama.cpp vs Ollama
- RAG Chunking: Why Chunk Size Is Everything
- LiteLLM & vLLM: One API to Rule All Your Models
- System Prompts: The LLM Feature Most People Ignore
- LLM Quantization: Q4_K_M Isn't Always the Best Choice
- Running Multiple Ollama Models Without Running Out of RAM
- Piper vs Coqui: Text-to-Speech on Your Own Hardware (Because AWS Polly Charges Per Character Like It's 1999 SMS)
- Context Window vs Token Limit: Not the Same Thing
- The Embedding Model Choice Nobody Explains
- Ollama Keep Alive: Unload Models from VRAM
- RAG on a Budget: Building a Knowledge Base with Ollama & ChromaDB
- Stable Diffusion vs ComfyUI vs Fooocus: AI Image Generation at Home
- n8n + LLM: Building Automations That Actually Think
- Text Generation Web UI vs KoboldCpp: Power User LLM Interfaces
- LangGraph vs CrewAI vs AutoGen: AI Agent Frameworks for Mere Mortals
- Open WebUI vs LibreChat: Self-Hosted ChatGPT Alternatives Compared
- LLM Fine-Tuning for Mortals: LoRA, QLoRA, and Your Gaming GPU
- Ollama Beyond the Basics: Model Management, Custom Models, and Optimization
- Whisper & Faster-Whisper: Self-Hosted Speech-to-Text That Actually Works
- Continue.dev vs Cody vs Tabby: AI Code Assists That Live on Your Machine
- CUDA vs ROCm vs CPU: Running AI on Whatever GPU You've Got
- Flowise vs Langflow: Build AI Pipelines Without Writing a Novel
- n8n vs Node-RED: Automate Everything Without Learning to Code (Much)
- Key Parameters of Large Language Models
- Prompts for Image Generation in Stable Diffusion
- Prompt Engineering for Generative AI 101
- Large Language Model Formats and Quantization
- Exploring the Diverse World of LLM Models
- Ollama: Powerful Language Models on Your Own Machine
- LocalAI: The OpenAI API, Self-Hosted
- Machine Learning models (AI)