2,000+ AI tools you can run locally Add tool

Ollama

An MIT-licensed local LLM runner and API for macOS, Windows, Linux and Docker, with optional cloud inference and coding agent integrations.

Alternative to:

DeepSeek

Screenshot of Ollama website

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

Local model use: Run and chat with models such as Gemma, Qwen and DeepSeek, or import models for use with the local runtime.
Application connections: Use the REST API or Python and JavaScript libraries to connect applications and manage models.
Coding assistants: Connect Ollama to tools including Claude Code, Codex, Copilot CLI and OpenCode.
Personal assistant integration: Use OpenClaw with Ollama to connect an AI assistant to channels such as WhatsApp, Telegram, Slack and Discord.

Ollama is open source under the MIT License and runs on macOS, Windows and Linux, with an official Docker image for server use. Its supported backends include llama.cpp.

Local inference runs on your computer or server. Optional cloud inference runs on Ollama's service instead. Ollama says it doesn't store prompts or use them for training.

Inference Servers and Clusters Local Model Runners macOS Windows Linux Docker ChatGPT & Claude alternatives AI for a modest PC AI for your Mac GGUF llama.cpp backend Multimodal input OpenAI-compatible API Streaming inference Structured output Tool calling

Similar to Ollama

Gemma

138 videos

An open-weight local LLM family for phones, PCs and servers, with Ollama and LM Studio support and a JAX library for fine-tuning.

5.8KUpdated 1 month agoApache-2.0

Android#LM Studio integration#LoRA#Multilingual

Gemma is Google DeepMind's family of open-weight AI models for developers building applications on their own hardware. It includes compact models for mobile and IoT devices and larger models for reasoning on personal computers and servers.

Edge and Embedded AIEmbedding and Reranker ModelsLLM Fine-TuningOpen-Weight LLMsVision-Language Models

LM Studio

91 videos

A local LLM app runs downloaded models for chat and agent tasks, with MLX and llama.cpp support and voice transcription processed on your device.

lmstudio.aiComputer and Browser Agents

macOS · Windows · Linux#llama.cpp backend#MCP#MLX

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

Computer and Browser AgentsDesktop Chat AppsLocal Model RunnersPersonal AI AssistantsSpeech-to-Text and Transcription

Open WebUI

39 videos

A self-hosted AI chat interface that works offline with local models and connects to Ollama, OpenAI-compatible APIs and cloud providers.

158.6KUpdated 6 days ago

Docker · Web#Code execution#Human approval#Hybrid search

Open WebUI is a self-hosted chat workspace for individuals and teams using local LLMs and cloud models. It can work entirely offline with local models.

Chat With Your DocumentsRAG and Vector SearchSelf-Hosted Chat Web UIs

Llama

49 videos

A local LLM family with downloadable text and vision models, base and chat variants, and custom licensing for research and commercial use.

7.7KUpdated 1 year ago

#Hugging Face integration#Multimodal input#Quantization

Llama is Meta's family of language models for developers, researchers and businesses building AI applications on their own hardware or servers. Downloadable weights let you choose a model for your application and available hardware.

Open-Weight LLMsVision-Language Models

OpenCode

114 videos

An open source AI coding agent works in your terminal or IDE with local models or cloud models including Claude, GPT and Gemini.

226.7KUpdated 1 day agoMIT

macOS · Windows · Linux#Code execution#Human approval#Multi-agent workflows

OpenCode is an AI coding agent for developers who want help writing code or exploring unfamiliar projects. You can choose a local model running on your hardware or connect a cloud provider.

Autonomous Coding AgentsTerminal Coding Agents

llama.cpp

92 videos

An MIT-licensed local LLM engine runs language and vision-language models on CPUs or GPUs, with quantization, hybrid execution and Docker support.

134.9KUpdated 21 hours agoMIT

Web#Code execution#GGUF#Hugging Face integration

llama.cpp is a local LLM inference engine for developers building AI applications or running models on hardware they control. It supports language and vision-language models, with command-line tools and a server API for using the engine directly or connecting other software.

Inference Libraries and BindingsInference Servers and ClustersLocal Model RunnersSelf-Hosted Chat Web UIs