Self-Hosted AI Tools You Can Run in Docker

Sillage is a self-hosted web interface for developers who want to control Claude Code, Codex and OpenCode from a computer or phone. It runs the native agent CLIs on your machine with their own tools and permission flows. Agents use your existing subscriptions and API credentials; hosting the interface doesn't replace their model providers.

Pi is a terminal coding agent for developers who want an assistant they can adapt to their projects. Its small core supports custom workflows through extensions and shareable packages.

Postgres MCP Pro gives AI assistants access to PostgreSQL databases and tools for investigating performance problems. It's for developers and database maintainers who want an assistant to work with actual schema details and query plans.

FiftyOne is a local tool for computer vision teams that need to inspect their training data and understand where their models fail. It runs on macOS, Windows and Linux, with Docker support, and is open source under Apache 2.0. Its Python tools and visual App connect dataset curation with model evaluation.

EmbedAnything is a local embedding pipeline for developers building semantic search and retrieval-augmented generation (RAG) applications. It turns documents and media into vectors for indexing in a vector database.

MemMachine gives developers building AI agents a way to remember earlier conversations and user preferences. Its memory persists across sessions, agents and model changes, so user history can carry over when an application switches models.

Paperless-ngx is a document management system for people who want a searchable archive of their scanned paperwork. It helps keep records such as invoices and tax documents available without searching through paper folders.

Morphik Core is a retrieval engine for developers building AI applications around documents whose meaning depends on charts, diagrams, or page layout. It brings document search and structured extraction into one platform.

SkyRL is a Python library for researchers and developers who want to train LLMs with reinforcement learning on their own hardware. Its Tinker API support lets you run existing Tinker training scripts against a server you control without changing the scripts. It's open source under Apache 2.0.

MaxKB is an AI agent platform for organizations building support bots, internal knowledge assistants and business automation. It combines answers based on company documents with workflows that can act through connected tools.

PrivateGPT is a self-hosted API layer for developers building applications around local models. It requires a separate inference server, such as Ollama, llama.cpp, vLLM or LocalAI; it doesn't run models itself.

Local Deep Research is a self-hosted AI research assistant for people investigating complex questions across web sources, academic papers and their own documents. It gathers evidence and writes reports with citations.

CleanRL is a Python deep reinforcement learning library for researchers and developers who want to study or modify an algorithm without tracing it through a large modular codebase. Each algorithm variant lives in one standalone file. Experiments can run locally, while Docker and AWS integration support cloud execution through AWS Batch.

QwenPaw is a personal AI assistant for people who want an agent on their own computer or server. It retains conversation history and a personal knowledge base across sessions.

GPT-SoVITS is a local voice cloning and text-to-speech tool for people creating speech in a custom voice. Its web interface covers speech generation, voice training and preparation of audio datasets.

Alexandria Audiobook turns books into audio with separate narrator and character voices. It's for people who want to choose the cast and correct individual passages before exporting an audiobook.

Arize Phoenix helps developers investigate failures in AI agents and LLM applications and compare proposed fixes. It connects recorded application activity with evaluations and repeatable experiments.

Mooncake provides storage and data transfer components for teams running distributed LLM inference. Its Transfer Engine and Mooncake Store support shared caching and deployments that separate prompt processing from token generation.

Onyx is an AI search and chat platform for teams with information scattered across workplace apps. It gives employees and AI agents answers grounded in company documents.

Ragpi is a self-hosted AI assistant API for teams that want to answer technical questions using their own project material. It lets developers add documentation-based support to a product, website or community.

Diariz is a self-hosted meeting transcription app for individuals and teams that want recordings and transcripts on their own server. It turns captured or uploaded audio into searchable meeting records.

Open WebUI is a self-hosted chat workspace for individuals and teams using local LLMs and cloud models. It can work entirely offline with local models.

LocalDocRAG is a self-hosted PDF question-answering app for people who want to search their documents with a local LLM and check answers against specific pages. It runs through Docker on macOS, Windows, Linux or a Raspberry Pi, with a browser interface accessible from phones and computers on the same network. It's open source under the MIT license.

RealChar lets you create AI companions with their own personalities and hold live voice or text conversations. It's for people who want to shape a character and host the app themselves while using external AI services for replies.

ACP Bridge lets teams and bots access coding agents running on a development machine or server through a shared HTTP API. It connects agents through the Agent Client Protocol (ACP), so callers don't need each agent installed on their own computer.

LiveAgent is a desktop AI agent for people who want an assistant to work with files and commands on their computer. Local tool execution is separate from model access, which uses Claude, Codex or Gemini protocols, or services compatible with those protocols through a custom API address.

Jina Reader is a web extraction API for developers building AI agents, search tools and systems that answer questions from retrieved documents. It turns page content into Markdown or JSON instead of passing raw HTML to an LLM.

Claude DevTools is a local debugger for developers who want to understand what happened during a Claude Code session. It reads saved logs from terminal and IDE sessions without modifying Claude Code.

Torrix is a self-hosted LLM monitoring tool for teams investigating AI spending and failed requests. It keeps request records in your infrastructure and brings usage analytics and individual traces into one dashboard.

Megatron-LM is a Python framework for researchers training large language models on NVIDIA GPU infrastructure. It provides reference training scripts for experimenting with models and studying distributed training.

PaddleX is a low-code toolkit for developers building AI applications with PaddlePaddle models. It brings pretrained pipelines and model training into one tool for applications that process documents, images or time-series data.

PentestGPT is an AI agent for security testers working on authorized penetration tests and capture-the-flag (CTF) challenges. It can carry out a test autonomously or let you guide the work in an interactive mode.

LangExtract is a Python library for developers who need to turn notes, reports or other text into structured data. It links extracted details to their original passages so people can check the results against the document.

Eidon AI is a self-hosted AI assistant for people who want everyday chat and agents that can carry out longer tasks on their own computer or server. A Chief of Staff agent answers directly, delegates work to specialists, or creates an agent for a task. Agents can message each other and keep working on a schedule.