2,000+ AI tools you can run locally Add tool

llama.cpp Installation, Setup & Tutorial Videos

Learn how to install and set up llama.cpp. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install llama.cpp: watch setup guides

40 videos

Magnitude vs llama.cpp: Mac setup and speed claims

Route Strata and llama.cpp through llama-swap

GGUF memory guide: Ollama, LM Studio and llama.cpp

llama.cpp vs vLLM, SGLang and TensorRT-LLM explained

OpenVINO vs llama.cpp: Intel Arc B580 benchmarks

GPT-oss 120B: local production tests and Qwen comparison

KoboldCpp vs Ollama: controls, context and defaults

Comparison

MiniCPM5-2B vs Qwen3.5-4B: local setup and coding tests

Comparison
Review
Setup

Pooled (SwarmLLM): distributed browser inference

MiniCPM5-2B review: local tool use and Qwen comparison

Qwen3.8-27B on Mac: setups for 16GB to 48GB

vLLM vs llama.cpp and LM Studio: DGX Spark benchmarks

Ollama, llama.cpp, LM Studio and vLLM compared

FreeToken vs llama.cpp: short and long context tests

llama.cpp

LM Studio, Ollama and Docker Model Runner setup

FreeToken vs llama.cpp: MoE speed and RAM requirements

Qwen3.8, Gemma 4 and gpt-oss: calculate KV-cache VRAM

Qwen 3.8 27B: llama.cpp RPC setup on Mac and Nvidia PC

audio.cpp review: local audio AI vs Ollama and whisper.cpp

Colibrì vs llama.cpp: DeepSeek V4 CPU comparison

llama.cpp

Pithagoras vs Hermes: a local AI agent harness review

llama.cpp setup and tuning with Qwen 3.6 and Gemma 4

SGLang vs vLLM vs llama.cpp: Qwen serving comparison

Comparison

NVIDIA Jetson: llama.cpp setup and Gemma 4 demos