Self-Hosted AI Tools You Can Run in Docker

Dopamine is a reinforcement learning framework for researchers who want to modify agents and test algorithm ideas. Its compact codebase focuses on a limited set of established algorithms and supports experiments on your own hardware.

AX is a self-hosted AI agent orchestrator for teams running autonomous tasks on Kubernetes. It manages agents that retain state and need access to models, repositories and tools while they work.

Flexible GraphRAG is a self-hosted platform for teams building document search and AI chat that use both text and relationships between entities. It extracts knowledge graphs from documents and combines graph retrieval with vector similarity and full-text search. You can run it standalone or in Docker. It's open source under Apache 2.0.

Codeg is an AI coding workspace for developers who use several agents and want to coordinate their work without losing context between tools.

Kokoro-FastAPI generates speech on your own machine or server using Kokoro-82M. It's for developers adding narration to reading apps, audiobooks or voice assistants through an OpenAI-compatible speech API.

Voicebox combines speech creation and dictation for people producing audio or working with AI agents. It's a free, open-source alternative to ElevenLabs and WisprFlow that processes voice data on your own machine.

OpenLLM is a self-hosted LLM server for developers connecting applications to models on their own hardware or servers. Its OpenAI-compatible interface lets existing clients use those models without adopting a separate API.

Abogen turns books, documents and subtitle files into narrated audio for readers making audiobooks and creators producing voiceovers. It can generate matching captions or follow timestamps for timed narration.

Langflow is a visual builder for developers creating AI agents and applications that answer questions using connected data. It lets you assemble workflows visually and customize their components in Python.

Codex Security is a locally run vulnerability scanner for developers and security teams, available as a CLI and TypeScript SDK. It can run on your machine, in CI or in containers, but sends AI analysis requests to a cloud model provider. Scans require provider credentials and an internet connection.

Riffado turns recordings from Plaud Note, Note Pro, and NotePin devices into searchable transcripts and summaries. It's for recorder owners who want control over AI processing and storage. Recording sync requires a Plaud account and access to Plaud's cloud, so the full workflow isn't offline.

GitHub MCP Server connects compatible AI assistants to GitHub so developers can ask about code and have an assistant act on repository activity. It's GitHub's official connector for the Model Context Protocol (MCP).

Chonkie is a library for developers preparing documents for retrieval-augmented generation (RAG). It brings document preparation and ingestion into one pipeline, with optional components to keep dependencies small.

XTuner is an LLM training engine for researchers working with very large mixture-of-experts (MoE) models. Its focus is reducing memory pressure and improving distributed training efficiency when model experts receive uneven workloads.

TrendRadar collects news and trending topics for people tracking public opinion, industry developments, or specific interests. It brings feeds and platform rankings into one place so you can follow relevant stories without checking each site separately.

nanobot is a self-hosted personal AI agent for people who want an assistant that can act on files and continue work across conversations. Its Python framework also suits developers building their own assistant integrations.

Octop is a self-hosted AI assistant for households and small teams that want personal agents in a shared deployment. Each user can switch between specialists with separate workspaces, model connections and scheduled tasks.

Atomic is a personal knowledge base for people who want to find connections across their notes and saved reading. It organizes Markdown notes, web clips, and articles into a knowledge graph you can search and explore.

Hollama is an LLM chat interface for people who want to use Ollama or OpenAI servers through a browser. It supports multiple server connections, so you can keep access to different model servers in one app.

Grist is a relational spreadsheet for teams building shared data tools beyond a flat grid. Linked tables, typed columns and custom layouts let users organize records into applications for their own workflows.

MCPHub is a self-hosted gateway for developers and teams connecting AI clients to multiple MCP servers. It gives them one place to manage shared tools and decide what each user or project can access.

Triton Inference Server, offered by NVIDIA as Dynamo-Triton, is a self-hosted AI inference server for teams deploying models in applications. It brings models from different frameworks into one serving system across on-premises, cloud and edge hardware.

DeerFlow is a self-hosted AI agent application for research, coding and content creation on your own infrastructure. It supports local models through Ollama and vLLM, including Qwen3, as well as hosted providers. With a cloud provider, model requests leave your server and may incur provider charges.

Soup is a local LLM fine-tuning tool for developers and teams adapting models to their own datasets. It brings training, evaluation and export into one workflow that runs on your own hardware without requiring a cloud service.

Manifest LLM Gateway connects AI agents and apps to local models, cloud providers and subscriptions through a shared endpoint. It's for builders and teams who want to choose where requests go, handle provider failures and track inference usage.

Pictaria Server helps Immich users explore their photo library, choose photos to keep and organize albums through a browser dashboard on their own hardware.

GROBID turns scientific and technical PDFs into structured TEI XML on your own machine or server. It's for researchers and developers who need article metadata, full text and bibliographical references for search, analysis or document collections. The software is open source under Apache 2.0.

RocketRide is an AI pipeline builder and runtime for developers creating document processing, search, and agent workflows. Its visual editor sits in VS Code, alongside the application code that uses those workflows.

SD.Next is a self-hosted web interface for artists and researchers who want to create and edit AI images and videos on their own hardware. It supports Stable Diffusion and other diffusion models.

Axolotl is a free, open-source LLM fine-tuning framework for developers and researchers adapting models to their own data. It supports training on local hardware or cloud infrastructure you control.

AI Documentation Generator analyzes repositories and writes documentation for developers who need to understand an unfamiliar codebase or prepare it for new contributors. It's open source under the MIT license and runs as a Python application, in Docker, or through a Claude Code plugin.

Mobile MCP connects AI agents to native iOS and Android apps for testing, form entry and extracting data from screens. Developers and testers can use the same tools across physical devices, simulators and emulators.

Graphiti is a Python framework for developers building AI agents that need to remember information as it changes. It turns conversations, structured records and unstructured text into a queryable graph with a history of facts.

AI Review is an AI code review tool for development teams that want automated feedback inside pull and merge requests. It runs in your CI/CD environment and uses your chosen LLM to review code against your team's guidelines.