Self-Hosted AI Tools You Can Run in Docker

FederatedScope is an open-source federated learning platform for researchers and teams building training systems across separate data holders. It can simulate clients and servers on one device or run them as separate distributed participants. Each participant loads its own data, while models can pass between participants through messages.

Twinny is an AI coding assistant for developers who want completion and help with their repository inside VS Code, using models on their own hardware or a chosen server.

LLM X is a browser chat interface for people running models on their own hardware. It brings multiple model servers into one place and lets you compare their responses within a conversation.

biniou brings AI chat and media creation into one browser interface on your own computer or server. It's for people who want to work with several kinds of generative AI without switching between separate apps.

MindsDB Query Engine gives developers building AI agents one SQL interface for business data and document search. It runs as a standalone server and can also provide data access to MindsHub agents.

Assistant is a self-hosted AI agent for people who want to delegate work by email and receive the results in their inbox. It uses a dedicated mailbox, separate from your personal email, and also accepts tasks through a browser workspace or dashboard. You control how much autonomy it has.

Auto Browser lets AI agents operate a live browser that a human can take over when a login or fragile page needs attention. It's built for internal dashboards, account workflows and operator-assisted browser QA.

Windmill lets developers build internal apps, data pipelines and AI automation around ordinary scripts. Teams can share that code through browser interfaces and run it on infrastructure they control.

Neo4j LLM Graph Builder converts documents and web content into knowledge graphs for people building searchable collections or AI applications with Neo4j. It uses an LLM to identify entities, relationships, and their properties.

Next AI Draw.io turns written descriptions and uploaded files into diagrams you can edit on a draw.io canvas. It's for people creating technical diagrams who want AI help with drafting and revisions while keeping control of individual shapes.

Viseron is a self-hosted network video recorder for people monitoring a home, office or other property. It combines camera recording with AI analysis that runs on your own hardware.

TaxHacker is a self-hosted AI accounting app for freelancers, indie hackers, and small businesses that need to turn receipts and invoices into searchable transactions. The project is in early development. Its open source edition runs on your own infrastructure or home server through Docker and uses the MIT license.

dots.ocr is a self-hosted OCR model for developers and teams that need text and page structure from multilingual documents. It combines text recognition and layout parsing in a single vision-language model you can run on your own hardware.

Kohya's GUI is a browser interface for training image generation models, aimed at artists and model makers who want to teach a model a style or subject. It builds on Kohya's Stable Diffusion training scripts and also provides a command-line interface.

Steel is a browser API for developers building AI agents that interact with websites. It supplies real Chrome sessions for tasks involving clicks, forms, logins and pages that rely on JavaScript.

Gitingest prepares code context for developers who want to give an LLM a repository or local directory. It gathers the project structure and file contents into a text digest instead of requiring you to assemble files by hand.

WindsurfAPI, also called DevinAPI, connects coding assistants and other AI clients to models through your own Devin account. The gateway runs on your hardware, but it sends prompts and images to Devin's cloud for inference, so it requires internet access.

DeepCell is an open-source Python library for researchers analyzing individual cells in biological images. It runs locally and uses TensorFlow to identify whole cells or nuclei and track cells through time-lapse movies. Its Apache 2.0 license allows users to adapt the library for their own research.

Dify is a visual builder for teams creating AI agents and applications that use their own data and tools. Its canvas makes application logic visible so teams can inspect and test how a task proceeds.

nvitop is a terminal GPU monitor for people running AI workloads on NVIDIA hardware. It shows GPU activity alongside the processes using it, so you can check resource use and investigate busy devices.

sage-wiki turns a document collection into a linked wiki and knowledge graph for researchers, teams, and AI agents that need reusable knowledge across tasks.

Notion Knowledge Assistant is a self-hosted Telegram bot for people who keep research, reference notes or study material in Notion. You run the Python app on your own hardware or server, including through Docker, but answers depend on OpenAI's paid cloud API. It also needs connections to Notion and Telegram, so self-hosting doesn't make it an offline assistant.

QAnything is a local knowledge base for people and teams who want to ask questions about their own documents. It supports offline operation and questions across Chinese and English document collections.

Adrian is a runtime security tool for teams whose AI agents can use tools or act on external systems. It checks planned actions against the agent's intended task and can intervene before an unsafe action runs.

ExtractThinker is a Python library for developers who want to extract structured data from documents using models running locally through Ollama. It also supports OpenAI, Anthropic and Groq. With a cloud provider, extraction sends document content to that service, requires provider credentials and may incur charges.

SearXNG is a self-hosted metasearch engine for people who want to combine search services without user tracking or profiling. It's a fork of searx, and web searches require internet access because external services supply the results.

PocketPaw is a self-hosted AI agent for people who want an assistant to write code, manage files and act on websites from their own computer or server.

E2B provides isolated execution environments for developers building coding assistants, computer-use agents and background jobs. You supply the model and agent logic; it supplies the machine where the agent works.

Infinity Embeddings is a self-hosted model server for developers building semantic search and retrieval-augmented generation applications. It runs retrieval models on your own hardware and can serve several models together.

PixlStash is an image manager for photographers culling shoots, creators reviewing AI images and people preparing datasets. It helps you find relevant pictures and review which ones to keep in large collections.

SimpleTuner is a diffusion model training toolkit for creators and researchers adapting image, video or audio models to their own datasets. Its web dashboard also supports teams sharing GPU workers.

Marqo Open Source is a self-hosted search engine for developers building document search, product discovery, or retrieval for AI applications. The project is deprecated and no longer receives updates.

Portkey Gateway routes application requests across model providers through an OpenAI-compatible API. It's for developers who need shared routing and failure controls when working with multiple AI backends.

Weft is a language and framework for developers who want to run AI workflow orchestration on their own machine. Its runtime requires Docker, and its graph editor works in VS Code and compatible forks. Self-hosting the workflow doesn't make its model calls local: the included WhatsApp support bot uses OpenRouter for inference.