Tag: llm

All the articles with the tag "llm".

OpenRouter vs LiteLLM

OpenRouter vs LiteLLM

Two ways to route LLM traffic across providers — OpenRouter as a hosted gateway, LiteLLM as a self-hosted proxy. Which one fits your home lab in 2026?

Function Calling in Local LLMs

Function Calling in Local LLMs

Local LLMs can call tools, query APIs, and run code if you set them up right. Function calling on Ollama and llama.cpp explained — patterns that actually work.

Gemma 4 vs Qwen3.6

Gemma 4 vs Qwen3.6

Gemma 4 vs Qwen3.6: sizes, reasoning, coding benchmarks, and which model you should actually pull for your home lab rig.

AnythingLLM as Knowledge Base

AnythingLLM as Knowledge Base

AnythingLLM is the closest thing to a real private NotebookLM you can self-host. Workspaces, RAG, agents, document chat — running locally on Ollama in 20 minutes.

MCP Servers: Tools for LLMs

MCP Servers: Tools for LLMs

Model Context Protocol turns your LLM into a tool-using agent — file access, APIs, your home lab. Build your first MCP server in under 50 lines of Python.

RAG Evaluation with Ragas

RAG Evaluation with Ragas

Most RAG demos look great until you ship them. Ragas measures faithfulness, context precision, answer relevancy — the metrics that actually predict user trust.

LLM Distillation Explained

LLM Distillation Explained

How tiny 7B and 8B models keep punching above their weight — knowledge distillation, the teacher-student trick that makes local AI actually usable on home hardware.

Self-Supervised Learning Explained

Self-Supervised Learning Explained

Self-supervised learning is the technique behind GPT, BERT, and modern LLMs. Learn how models teach themselves from unlabeled data.

Ollama Model Management: Beyond ollama run

Ollama Model Management: Beyond ollama run

You can pull and run a model. Now learn Modelfiles, GPU layer tuning, the REST API, running multiple models without OOM-killing your server, and useful system prompts.