Self-Hosted AI Tools You Can Run in Docker

Minima lets you ask questions about your own documents, with a choice of local inference or an external model. It's a self-hosted RAG tool for people and teams who want document-based answers while controlling where indexing and AI processing happen. It runs in Docker containers and is open source under the Mozilla Public License 2.0.

OneRAG is a self-hosted RAG framework for developers building chatbots that answer questions using their own documents. It combines document retrieval and AI answers, with replaceable components for different models and search needs.

n8n-MCP connects AI assistants to n8n so automation builders can create and maintain workflows through tools such as Claude, ChatGPT and Cursor. It's a connector for an assistant you already use, rather than a standalone AI agent.

Stash gives AI tools persistent memory so preferences, plans and working context can carry into later conversations. It's for people switching between AI tools and developers building agents that need information to survive between sessions.

Kodus is an AI code reviewer for engineering teams that want automated pull request feedback and control over where the reviewer runs. Its reviewer, Kody, checks changes in the context of the surrounding code.

Tutor-GPT is a self-hosted browser application for learners who want an AI tutor that adjusts to their learning needs. You can host its Next.js server yourself, including through Docker. Model responses come from a separate inference provider, with OpenRouter integration sending requests to an external service.

DL4MicEverywhere lets microscopy researchers train and use deep learning models on their own computers through graphical Jupyter notebooks. It builds on ZeroCostDL4Mic, bringing its bioimage analysis workflows to local machines and remote computing infrastructure. You don't need coding skills to use the notebook interfaces.

DiffRhythm is an AI music generation model for musicians and developers who want to create full-length songs on their own hardware. It uses diffusion to generate songs from lyric and reference-audio inputs.

Speaches is a self-hosted speech server for developers building transcription services and voice applications. Its OpenAI-compatible API lets existing clients and SDKs work with speech models running on hardware you control.

OpenTutor is a local AI learning workspace for students who want to study their own course materials with a tutor that adjusts to their progress. It targets individual study rather than shared classroom use.

Stirling PDF is a PDF workspace for editing individual documents and automating larger document workflows. It runs through a browser on your own server, with Docker deployment, or as a desktop application for Windows, macOS and Linux.

OpenRAG is a self-hosted platform for searching documents and asking questions about them through an AI chat interface. It brings Langflow, OpenSearch, and Docling together for developers and teams that want a document knowledge base with control over its retrieval workflows. It's open source under Apache 2.0 and supports self-managed deployment with Docker or Podman.

Capka is a self-hosted AI agent for people and teams whose work ends in a document, spreadsheet or code patch. It works with uploaded files, runs code and returns editable outputs you can revise through conversation. The app and its Linux sandboxes run on your own server.

Karakeep is a bookmark manager for people collecting articles, notes, images and PDFs for later use. It keeps saved material searchable and can preserve pages after their original links disappear.

Feeds Fun is an RSS reader for people who want to prioritize articles across their subscriptions. It assigns tags automatically and uses your scoring rules to decide which entries appear first.

OpenLIT helps developers investigate failures and assess the quality of existing AI applications and coding agents. It connects model requests with the tools, retrieval and agent steps involved in producing an answer.

Intel Neural Compressor is a Python library for developers who want to compress AI models for deployment on their own hardware or servers. It supports LLMs and other deep learning models, with extensive testing on Intel platforms.

Langfuse helps teams debug LLM applications and AI agents, then test changes against production examples. It brings traces, evaluations and prompt revisions into one place.

LunarGate is a self-hosted AI gateway for teams whose apps use multiple model providers. It gives those apps one OpenAI-compatible endpoint and keeps routing, retries and fallback rules in your infrastructure. The gateway is open source under the MIT license and runs on macOS and Linux, with a container image also available.

AudioNotes turns audio and video into transcripts and structured Markdown notes on your computer. It's for reviewing meetings, interviews, courses and voice memos while keeping the recordings and resulting notes locally.

Hindsight is a memory system for developers whose AI agents need to carry facts and experience across sessions. It combines stored memories into observations and maintains answers to recurring questions as more information arrives.

GLaDOS is a local AI voice assistant for people who want a conversational companion modeled on the personality core from Valve's Portal games. It combines a custom voice and dry humor with awareness of its surroundings.

F5-TTS is a local text-to-speech system for developers and creators generating speech on their own hardware. Its Gradio app provides a browser interface for speech generation, with tools for training and fine-tuning models.

miel is a self-hosted Gmail client for people who want AI help sorting mail while keeping the app and its database on their own machine or server. It ranks messages by priority and proposes labels, including new ones. You review suggestions before applying changes to Gmail.

Mosec is a self-hosted model serving framework for developers turning trained machine learning models into APIs. It runs on Linux and macOS, on your own hardware or cloud servers, and is open source under the Apache 2.0 license. Its main focus is handling concurrent requests while making better use of CPU and GPU resources.

Paperless-AI is an extension for Paperless-ngx users who want to sort incoming documents automatically and ask questions about their archive. The project is no longer maintained.

Parakeet is NVIDIA's speech recognition model family. The linked English model, parakeet-tdt-0.6b-v2, is for developers building transcription services, subtitles and voice applications with a model they can run locally.

Wan2GP generates media on your own computer for creators who want to work with several AI models in one browser interface. It builds on Wan-Video/Wan2.1 and focuses on making generation accessible on GPUs with limited memory.

Codel is a self-hosted AI agent for people who want software to carry out multi-step tasks and projects using a terminal, web browser, and text editor. It chooses and performs the next action itself, with task execution inside a sandboxed Docker environment. You access its interface through your browser.

DeepEthogram assigns predefined behavior labels to individual video frames. It's designed for neuroscience researchers measuring animal activity, and can also serve other projects that need action detection at frame level.

Discord Ollama Bot lets a Discord community chat with language models hosted on the owner's hardware. It's for server owners who want to choose their own models and make an AI assistant available inside Discord.

Wyoming Satellite connects a microphone and audio playback device to Home Assistant for a self-hosted voice assistant. The project is archived and no longer maintained; Linux Voice Assistant replaces it using the ESPHome protocol.

Text Generation Inference (TGI) serves LLMs on your own hardware for developers building chat apps and text generation services. The project is archived and no longer receives updates.

Bytebot carries out tasks described in plain language on its own virtual desktop. It's for people automating document work, research, or tasks across several applications. The project is archived and no longer maintained.