2,000+ AI tools you can run locally Add tool

llama.cpp Installation, Setup & Tutorial Videos

Learn how to install and set up llama.cpp. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install llama.cpp: watch setup guides

58 videos

Hermes Agent setup with llama.cpp and Gemma 4

Magnitude vs llama.cpp: Mac setup and speed claims

Route Strata and llama.cpp through llama-swap

Llama.cpp setup: GGUF models, GPU tuning and OpenCode

OpenVINO vs llama.cpp: Intel Arc B580 benchmarks

MiniCPM5-2B vs Qwen3.5-4B: local setup and coding tests

Pi and llama.cpp: local GGUF model setup

Qwen3.8-27B on Mac: setups for 16GB to 48GB

FreeToken vs llama.cpp: short and long context tests

llama.cpp

Dell GB10 setup with llama.cpp, llama-swap and vLLM

Herdr setup: local agents, VPS sessions and Tau

Qwen 3.8 27B: llama.cpp RPC setup on Mac and Nvidia PC

Hex AI Girlfriend: Windows setup with Qwen3 and ComfyUI

Llama Forge: configure llama.cpp models on Mac

llama.cpp

llama.cpp setup and tuning with Qwen 3.6 and Gemma 4

Pi Agent and llama.cpp: local coding setup and skills

Hugging Face speech-to-speech: local voice AI setup

NVIDIA Jetson: llama.cpp setup and Gemma 4 demos

llama.cpp setup: Qwen3.6-35B-A3B on a 6GB GPU

llama.cpp setup on Windows 11 with AMD or Nvidia

Hermes Agent setup with Ollama and Obsidian

llama.cpp on a 4 GB PC: Gemma and Qwen performance

Qwen 3.5 with llama.cpp and OpenCode: local coding setup

Inkling: setup with Transformers and llama.cpp