Self-Hosted AI Tools You Can Run in Docker

Tel-Agent is a self-hosted AI receptionist for businesses that want phone calls and customer messages handled in one place. It runs on your own hardware and keeps recordings and searchable transcripts on your machine. It's free and open source under the AGPL-3.0 license.

Karakeep is a bookmark manager for people who collect links, notes, images and PDFs in one place. You can run the open source app on your own server with Docker under the AGPL-3.0 license, or use the managed Karakeep Cloud service. It has a web app, iOS and Android apps, and extensions for Chrome, Firefox and Safari.

Wan2GP brings video, image, music and speech generation to your own computer, with particular attention to GPUs with limited memory. It's for creators who want several media models in one browser interface. The project builds on Wan-Video/Wan2.1.

Graphiti is a self-hosted Python framework for developers building AI agents that need to remember changing facts. It builds knowledge graphs from conversations, structured records and unstructured text, so an agent can query current information or recover what was true earlier. It's open source under Apache 2.0.

Sim is an AI agent workspace for teams that need to build automations and control how people use them across an organization. You can self-host it on your own server or cloud with Docker or Kubernetes. Its open-source code uses the Apache 2.0 license.

OpenClaw is a self-hosted AI assistant that connects your own computer to the messaging services you already use. It's for people who want a personal assistant on their laptop, or teams that want to run a shared assistant on their own hardware. The project is open source under the MIT license.

Firecrawl helps developers give AI agents and applications access to current web content. It searches for pages, extracts their contents, and returns data in forms an application can use. The project is open source under AGPL-3.0 and can run on a self-hosted server. Firecrawl also offers a hosted service that requires an account and API key and includes additional features. Reaching live websites requires an internet connection.

AnythingLLM is an open source AI assistant for people who want to chat with their documents and use AI agents on their own hardware. The desktop app runs on Windows, macOS and Linux, while a Docker deployment supports multiple users on a self-hosted server. No account is required for the desktop app.

Langflow is a visual builder for developers creating AI agents and retrieval-augmented generation (RAG) applications. You can run it locally or on your own server, with Docker support and desktop apps for Windows and macOS. The open-source software uses the MIT license. A hosted cloud offering provides a separate deployment option.

Onyx is an AI search and chat platform for teams whose information is spread across workplace apps. It indexes company knowledge so employees can ask questions across sources and get answers grounded in relevant documents. Teams can deploy it in their own cloud or on bare metal, including an air-gapped environment.

Qdrant is a self-hosted vector database for developers building semantic search, retrieval-augmented generation (RAG), recommendations and AI agent memory. It stores embeddings alongside JSON metadata, so applications can find similar content while restricting results by attributes such as location, text or numeric ranges. The Rust engine is open source under Apache 2.0 and runs locally in Docker or on your own servers.

vLLM is an open source engine for serving large language models on hardware you control. It suits developers and teams that need to handle many requests through an API while making efficient use of memory and compute. It's licensed under Apache 2.0 and can run with GPUs or on a CPU.

GPT Researcher is a self-hosted AI research agent for people who need detailed, cited reports drawn from the web, their own documents, or both. You choose the language model and search provider, and can run the software on your own server or through Docker. It's open source under Apache 2.0.

LightRAG combines knowledge graphs with vector search to answer questions across a document collection. It's a self-hosted Python framework for developers building document assistants, particularly where answers depend on relationships between facts in different files, such as legal or financial material.

SD.Next is a self-hosted web interface for artists, researchers and people who want to generate and edit images or videos on their own hardware. It builds on Automatic1111 WebUI's original codebase and supports Stable Diffusion alongside other diffusion models. It's open source under Apache 2.0.

SearXNG is a self-hosted metasearch engine for people who want web search without user tracking or profiling. It brings results from separate search services into one browser interface. You can run your own instance or use a public one, depending on who you want to trust with your searches.

Dify is a source-available platform for teams building AI agents and apps on a visual canvas. Its Community Edition runs on your own server with Docker. Dify also offers a hosted cloud service, while Enterprise deployments can run in a VPC or on a self-hosted server. The Community Edition uses a custom Apache 2.0 derivative license.

Agno is a Python framework and runtime for developers building customer-facing or internal AI agents. You can run its agent platform locally with Docker, on your own servers or in your cloud. The open-source framework uses the Apache 2.0 license, and the platform keeps sessions, memory, knowledge and traces in your database.

RAGFlow is an Apache 2.0 licensed RAG engine for teams building AI agents that need to answer questions from their own documents. It can run on a self-hosted server through Docker on Windows, macOS or Linux. A separate hosted cloud service is available.

Open Notebook is a self-hosted alternative to Google's NotebookLM for researchers, students, and professionals who want AI help with their own research materials. It runs locally or on your server through Docker and is open source under the MIT license. You choose which content the AI can access and which provider processes it.

Activepieces brings AI agents and workflow automation into one workspace for teams that need to connect their apps and internal data. It runs on your own servers with Docker or Kubernetes, or as a managed cloud service. An isolated deployment can keep platform data on its own infrastructure; connected apps and model providers may still require external access. Its core and app integration pieces are MIT-licensed.

Serena is a locally run MCP toolkit that gives AI coding agents access to code structure: functions, classes and the references between them. It's for developers who want their agent to find and change specific parts of a codebase without reading whole files or relying on text matching. It requires an LLM client and works with Claude Code, Codex, OpenCode, Cursor and OpenWebUI.

Langfuse is an open source observability and evaluation platform for teams building LLM applications and AI agents. It shows the steps behind a response so developers can investigate failures, slow requests, and cost. Teams can run its MIT-licensed core on their own servers with Docker Compose or Kubernetes, or use Langfuse Cloud as a hosted service.

Hermes Agent is a self-hosted AI agent from Nous Research for people who want an assistant that remembers past work and develops reusable skills. It creates skills after complex tasks, revises them through use, and searches earlier conversations to recover context across sessions. The project is open source under the MIT license.

AFFiNE is a local-first knowledge workspace for individuals and teams who want documents and visual planning in the same place. It combines a block editor, an edgeless whiteboard and databases, making it an alternative to Notion and Miro for team wikis, project plans and connected notes.

InvokeAI is a free, open-source image generator for artists and production teams who want to create and edit images on their own hardware. Its locally hosted web interface brings image generation, canvas editing and workflow tools into one application. With local models, prompts and artwork stay on the machine you control.

SiYuan is a local-first, self-hosted knowledge workspace for people who want linked notes, research material and AI writing tools in one place. Its block references let you connect individual passages rather than whole documents, with bidirectional links to follow those connections. It's open source under AGPL-3.0.

whisper.cpp runs OpenAI's Whisper speech recognition models on your own hardware, with fully offline transcription once you've downloaded a model. It's for developers building speech-to-text into applications and people who want to transcribe audio locally. Audio can stay on-device rather than going to a cloud transcription service. The project is open source under the MIT license.

Open WebUI gives individuals and teams a self-hosted place to chat with local LLMs and cloud models. It runs on your own computer or server, including through Docker, and can work entirely offline with local models.

Ollama runs language models on your own computer or server. It provides a command-line runner and a local API for people building AI applications or connecting existing tools to models they host themselves. The software is distributed under the MIT license.

rembg removes image backgrounds on your own hardware, with batch processing and a Python library for developers building image workflows. It's also useful for people preparing product cutouts or portraits who want control over processing and model choice. Local models keep images on your machine and can work offline once downloaded.

Paperless-ngx is a self-hosted document management system for people who want to keep scanned paperwork in a searchable digital archive. It brings document scanning, indexing and storage together, so you can find records by their contents rather than sift through paper folders. You can run it on a local server at home, and it supports deployment with Docker.

LocalAI runs language models, speech, vision and image generation on hardware you control. It's for developers and teams that want a self-hosted AI server for their apps without sending model requests to a cloud service. Its OpenAI-compatible API works with existing clients, and it also accepts Anthropic, Ollama and ElevenLabs API calls.

Unsloth brings model training and everyday AI use into a desktop app for people who want to run models on their own hardware. Its no-code interface covers chat, fine-tuning and media generation on macOS, Windows and Linux. The Unsloth software is open source under Apache 2.0.

PicApport is a self-hosted photo server for families and businesses that want a searchable media archive on their own hardware. Its AI tagging add-on recognizes image content without sending photos to a cloud service and saves the resulting tags in image metadata. The server runs on Windows, Linux or macOS, with a Docker image available, and you access the gallery through a browser.

ScribeDog is a Markdown editor for writers and note-takers who want AI assistance while keeping their documents on their own hardware. It displays formatted text, tables and images instead of Markdown syntax, but saves ordinary .md files that work with Git and other editors. It has a native desktop app and a self-hosted Server Edition available through Docker.