800+ AI tools you can run locally

vLLM Installation, Setup & Tutorial Videos

Learn how to install and set up vLLM. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install vLLM: watch setup guides

9 videos

Ollama, llama.cpp, LM Studio and vLLM compared

vLLM and LLM-D: GPU serving and Kubernetes setup

Qwen3.8-27B: serving with vLLM and SGLang

SGLang vs vLLM vs llama.cpp: Qwen serving comparison

Comparison

llama.cpp vs vLLM: choosing a local inference engine

llama.cpp vs vLLM: model loading and quantization

KServe tutorial: Iris models and Triton troubleshooting

Hermes Agent setup with vLLM, Proxmox and Open WebUI

vLLM tutorial: Hugging Face comparison and API setup

llama.cpp
vLLM