2,000+ AI tools you can run locally Add tool

vLLM Installation, Setup & Tutorial Videos

Learn how to install and set up vLLM. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install vLLM: watch setup guides

58 videos

vLLM and SGLang: LLM serving and batching explained

vLLM and Qwen3: GPU inference setup and tuning

vLLM speculative decoding: Blackwell workload comparison

vLLM

SGLang and vLLM: how inference engines work

NVIDIA Switchyard: routing Nemotron vs DeepSeek

Ray and vLLM: scaling synthetic data at DatologyAI

Overview

vLLM

GGUF memory guide: Ollama, LM Studio and llama.cpp

Exo on DGX Spark and Mac: demo and hardware comparison

Comparison
Overview

llama.cpp vs vLLM, SGLang and TensorRT-LLM explained

vLLM setup: Python inference and a local API server

vLLM

vLLM and Jamba: debugging silent inference bugs

Tutorial

BMW's Ray and vLLM gateway vs Claude API costs

NVIDIA NeMo Guardrails on Red Hat AI: deployment tutorial

Hermes and OpenClaw: OpenShell sandbox setup

vLLM vs SGLang: GPU inference and KV cache tutorial

DGX Spark home lab: vLLM, Ollama and Copilot CLI

Qwen 3.8 27B and Hermes Agent: vLLM setup and comparison

vLLM vs llama.cpp and LM Studio: DGX Spark benchmarks

Ollama, llama.cpp, LM Studio and vLLM compared

Dell GB10 setup with llama.cpp, llama-swap and vLLM

Qwen 3.8 Flash Next + Hermes Agent: vLLM setup

Pipecat PhoneLLM Alpha 1: local setup with vLLM

vLLM

LMCache vs vLLM prefix caching: gains and tradeoffs

Granite 4.2 3B vs 8B: local setup and reasoning tests