2,000+ AI tools you can run locally Add tool

llama.cpp Installation, Setup & Tutorial Videos

Learn how to install and set up llama.cpp. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install llama.cpp: watch setup guides

92 videos

FreeToken vs llama.cpp: MoE speed and RAM requirements

Qwen3.8, Gemma 4 and gpt-oss: calculate KV-cache VRAM

Comparison
Tutorial

Qwen 3.8 27B: llama.cpp RPC setup on Mac and Nvidia PC

Hex AI Girlfriend: Windows setup with Qwen3 and ComfyUI

audio.cpp review: local audio AI vs Ollama and whisper.cpp

Frigate 0.18: UI setup, AI chat and motion search

Colibrì vs llama.cpp: DeepSeek V4 CPU comparison

llama.cpp

Frigate 0.18 beta: UI setup, profiles and GenAI chat

Llama Forge: configure llama.cpp models on Mac

llama.cpp

Pithagoras vs Hermes: a local AI agent harness review

llama.cpp setup and tuning with Qwen 3.6 and Gemma 4

Pi Agent and llama.cpp: local coding setup and skills

Hugging Face speech-to-speech: local voice AI setup

SGLang vs vLLM vs llama.cpp: Qwen serving comparison

Comparison

NVIDIA Jetson: llama.cpp setup and Gemma 4 demos

Comparison
Setup
Tutorial

llama.cpp vs vLLM: choosing a local inference engine

llama.cpp setup: Qwen3.6-35B-A3B on a 6GB GPU

llama.cpp setup on Windows 11 with AMD or Nvidia

Nativ vs LM Studio and Ollama on Apple Silicon

llama.cpp: CPU and H100 tests with Kimi, GLM and MiMo

Comparison

llama.cpp, vLLM and ODS: inference stack comparison

Hermes Agent setup with Ollama and Obsidian

llama.cpp on a 4 GB PC: Gemma and Qwen performance

Qwen 3.5 with llama.cpp and OpenCode: local coding setup