1,700+ AI tools you can run locally Add tool

Llama Installation, Setup & Tutorial Videos

Learn how to install and set up Llama. Watch installation guides and tutorials with summaries and chapter links to find the steps you need.

How to install Llama: watch setup guides

12 videos

GGUF memory guide: Ollama, LM Studio and llama.cpp

LM Studio, Ollama and Docker Model Runner setup

vLLM and LLM-D: GPU serving and Kubernetes setup

Portkey, LiteLLM and Bifrost: LLM gateway tutorial

NeMo Guardrails, LangSmith and Logfire beginner tutorial

BitNet b1.58 vs Qwen 2.5: CPU benchmarks and caveats

llama.cpp vs vLLM: model loading and quantization

Outlines and Guidance: structured LLM output tutorial

Llama Guard 3, Prompt Guard and CodeShield overview

Overview

RouteLLM overview: GPT-4 routing costs and comparisons

Llama

LLM tutorial: local models, shell pipelines and RAG

GPT4All
+7 more

Petals setup: distributed LLaMA inference with Google Colab

Llama