Self-Hosted AI Tools You Can Run in Docker

Paperwise turns PDFs, scans and records into a searchable library for people managing private documents. It answers questions across files and links its answers to the source pages so you can check the evidence.

Moltis is a personal AI agent server for people who want an assistant that remembers earlier conversations and carries out tasks on their own hardware. You can reach the same agent through a browser or messaging apps.

OwnOrbit AI, formerly LifeOS AI, is an alpha self-hosted personal AI assistant for people who want help finding forgotten commitments in their own notes. It reads a Markdown folder you control and can surface deadlines, renewals, and unfinished work. The assistant runs on your computer, with a paired mobile browser app for phone access.

Usertour helps teams build in-app guidance for browser applications. It's an alternative to Appcues and Userflow for teams that want to host their onboarding platform themselves.

OpenViking is a self-hosted context database for developers who want AI agents to retain preferences and task experience across sessions. Its open source server runs on your own machine or server, including Docker deployments. It needs embedding and vision-language models, with support for local Ollama and cloud providers such as OpenAI and Volcengine; self-hosting the database alone doesn't keep model requests local.

NeMo RL is NVIDIA's Python library for researchers and engineering teams adapting language and multimodal models on their own hardware. It supports experiments on a GPU workstation and distributed training across multiple nodes.

Willow Inference Server is a self-hosted speech server for developers building voice assistants, transcription apps, and accessible interfaces. It handles speech recognition and speech generation on your own hardware.

Data Formulator is a local AI data analysis workspace for analysts who want to explore questions through charts and keep track of alternative investigations. This Microsoft Research project combines natural language requests with direct chart editing. You can revisit an earlier result and branch into a different analysis without losing the original path.

Bolt.diy is an AI coding assistant for building full-stack Node.js web applications with your choice of model. It's a fork of Bolt.new that combines generated code with an editable development workspace.

Eclaire is a self-hosted AI assistant for people who want to ask questions about their saved information and act on it in one place. It brings documents, notes, photos, bookmarks and tasks into a shared library.

MaxText is an LLM training library for researchers and engineers building models from scratch or adapting existing ones. It provides a reference implementation teams can modify for their own model designs, with training that scales from a single host to large clusters.

Unmute gives text LLMs a spoken conversation interface using Kyutai speech recognition and speech synthesis. It's for developers who want to self-host voice chat while choosing their own language model.

DocNavigator is a self-hosted AI chatbot builder for teams that want customers to ask questions about their product documentation or support content. It uses information from a company's website as the basis for the chatbot, so responses can draw on that company's material.

Jina Embeddings is a family of models for developers building semantic search, retrieval-augmented generation (RAG) and AI agent applications. The models convert content into vectors that a search system can compare for relevance.

VoiceStreamAI turns live browser audio into text on a server you control. It's for developers adding streaming transcription to an app or building a speech-to-text service around Whisper.

LibreDB Studio is a self-hosted database IDE for developers and database teams who want browser access to data inside their own network. It can run beside the database, with an interface that also works on phones and tablets.

ReMe gives AI agents lasting memory across conversations. It's for developers who want coding assistants or personal agents to retain useful facts, preferences, and procedures in files they can inspect and edit.

Alfred Black is a self-hosted AI agent for people who need help tracking messages, tasks and ongoing commitments. It runs continuously and brings related information together so you can review a concern without piecing together scattered threads.

CVAT is a data annotation platform for teams preparing datasets for computer vision and audio models. It combines labeling tools with shared assignments and review workflows.

Claude Code Router is a local gateway for developers using coding agents such as Claude Code, Codex and OpenCode. It keeps provider selection and request routing in one app, while the selected cloud provider processes model requests remotely. Those requests leave your machine.

SillyTavern is a locally installed interface for AI hobbyists who want control over prompts and access to text, image and voice models in one place. It's an independently developed fork of TavernAI and connects to a separate model backend or API provider.

Coze Loop helps developers test and monitor AI agents, with tools for investigating failed runs and comparing prompt changes. Its self-hosted edition brings prompt development, evaluation, and execution traces into one browser interface.

Examor is a self-hosted study app for students, interview candidates and people who want regular practice from their own notes. The app runs on your machine through Docker and opens in a browser. GPT generates tests and assesses answers; local hosting describes the study application, rather than a local model runner.

Whisper WebUI turns recordings into transcripts and subtitles through a browser interface running on your own machine. It's for people captioning videos or translating speech who want local audio processing.

PicApport is a self-hosted photo server for families and businesses that want to organize and search a shared media archive on their own hardware. Its browser gallery handles photos, videos and PDFs, with plugins for camera RAW files and other formats.

MCP Context Forge is a gateway and registry for teams connecting AI clients to multiple tools, agents and services. It gives them one place to discover available services, control access and inspect calls.

Trilium Notes is a note-taking app for people building large personal knowledge bases. Its tree structure lets one note appear in multiple branches, so you can organize related material without keeping separate copies.

AnythingLLM is an AI assistant for people who want document chat and agents on their own hardware. Its desktop app can work with local models without an account or cloud API key.

Vearch is a self-hosted, distributed vector database for developers building AI applications that search embedding vectors. It combines similarity search with filters on stored fields, so an application can retrieve related content while applying criteria beyond vector similarity. It's open source under Apache 2.0 and can run on your servers through Docker, Docker Compose, or Kubernetes.

Hope Agent is a desktop AI assistant that can also run without a desktop interface on a NAS or cloud server. It's for people who want ongoing project work, memory and task state to carry across sessions and devices. It supports local model setup. Data stays on the hosting machine by default, while requests to remote models go directly to the selected provider.

Anakin is a web scraping API for developers feeding website content into AI agents, RAG pipelines, or data extraction workflows. You can run its scraping engine on your own server or use the hosted service.

OpenScribe is an AI medical scribe for clinicians who want to turn recorded patient encounters into structured draft notes. Its desktop workflow builds on StenoAI and keeps transcription and note generation local. It's not HIPAA compliant, and every generated note requires clinical review.

PDFMathTranslate translates scientific papers for readers who need the text in another language while keeping equations and figures in context. It produces translated and bilingual PDFs so readers can compare the result with the original.

Whisper ASR Webservice gives developers a speech-to-text API for their own applications and services. It processes audio on your machine or server and supports multilingual transcription, speech translation and language identification.