2,000+ AI tools you can run locally Add tool

vLLM Installation, Setup & Tutorial Videos

Learn how to install and set up vLLM. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install vLLM: watch setup guides

58 videos

GuideLLM v0.7: benchmark vLLM and agentic workloads

vLLM and LLM-D: GPU serving and Kubernetes setup

Qwen3.8-27B: serving with vLLM and SGLang

Qwen 3.8 27B review and vLLM setup with Hermes

Nemotron 3 Ultra on DGX Station: agent setup explained

Terraform and KServe: scale LLM inference on Crusoe

OpenCode vs Aider vs Pi: local coding agent comparison

SGLang vs vLLM vs llama.cpp: Qwen serving comparison

Comparison

llama.cpp vs vLLM: choosing a local inference engine

Comparison
Overview

llama.cpp, vLLM and ODS: inference stack comparison

Comparison
Overview

vLLM on Crusoe Cloud: Docker setup and chat API tutorial

vLLM

LLM Compressor updates and llm-d distributed serving

Unlimited-OCR deployment with vLLM and SGLang

Setup

Unlimited-OCR: Kaggle setup and memory fixes

Setup
Tutorial

llm-d: Kubernetes inference routing explained

Overview

NVIDIA Dynamo and Gcore: distributed inference explained

Overview

llama.cpp setup: JSON output, local API and Chatbox

Chatbox
+3 more

NVIDIA Dynamo explained: distributed LLM serving

Overview

Intel Arc Pro B70: llama.cpp and vLLM setup compared

LM Studio vs Ollama: headless server setup on RunPod

vLLM, Tunix and MaxText: Google TPU setup and demos

ASUS GX10, vLLM and OpenCode: one vs two nodes

Hermes Agent with Qwen 3.6 27B: vLLM setup and review

DeepSeek V4 with vLLM: launch-day consumer GPU failures

vLLM