Self-Hosted AI Tools You Can Run in Docker

Podcastfy turns source material into podcast-style audio conversations for creators and developers. It's an alternative to NotebookLM's podcast feature for people who want to customize the conversation or include podcast generation in their own software.

Flawless provides CISRE, a self-hosted AI SRE platform for teams investigating Kubernetes incidents. It connects evidence collection and diagnosis with approved changes and checks that the affected resource has recovered.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

AgentArk is a self-hosted AI agent runtime for people who want a personal assistant that remembers preferences and carries out ongoing work under their control. It runs through Docker on macOS, Windows and Linux, with a browser interface for chat, tasks and action review. It's free and open source under Apache 2.0.

Agent Zero is a self-hosted AI agent framework for people who want an assistant to carry out research, coding, and document work on a computer. You can watch its actions and intervene in the same desktop with your mouse and keyboard.

PandaWiki is a self-hosted knowledge base for teams publishing product guides, technical documentation, FAQs, or blogs. It gives readers AI-assisted ways to find answers within those documents.

OpenMAIC is a self-hosted AI classroom platform for learners and educators building lessons from a topic or their own materials. AI teachers and classmates explain concepts and discuss questions during the lesson.

OSWorld is a benchmark for researchers and developers testing AI agents that use computers. It measures task completion in real desktop environments, including workflows that cross application boundaries.

DeepAudit is an AI code security auditing platform for developers and security researchers who want to investigate vulnerabilities in their projects. It combines automated code review with executable tests to help assess whether suspected flaws are exploitable.

Phantasm is an iPhone AI chat app for people who want to use models running on their own machines. The phone provides the chat interface, while a backend you control handles inference.

Lemonade is a local AI server for people who want to chat with models on their own hardware or use them in apps and agents. It includes a built-in interface for direct use and APIs for connecting other software.

unbagrnd removes image backgrounds locally for people who need cutouts without uploading pictures to a cloud service. It includes an app for individual images and folders, plus a self-hosted API for developers.

Agnai is an AI roleplay chat app for people who want conversations with fictional characters, including shared chats with other people. It builds on early work from Galatea-UI by PygmalionAI.

Oumi helps ML researchers and teams build specialized AI models for their own tasks. It brings data preparation, training, evaluation, and deployment into one platform, with reusable recipes and components you can customize.

jetson-stats monitors NVIDIA Jetson boards and controls their power and cooling settings. It's for developers running workloads, including local AI, who need to inspect resource use and adjust how their board operates.

MONAI is a framework for researchers and developers building AI models for medical images. Its Core library provides medical-specific tools for training and evaluating models within existing PyTorch workflows.

Voice-Clone-Studio brings voice cloning and speech production into one browser interface for people making podcasts, audiobooks and dialogue recordings. It combines several engines with tools for preparing samples and training custom voices.

Tiledesk is an AI chatbot and live chat platform for teams handling customer support and internal information searches. Its visual builder lets teams design conversations and automated workflows without writing code.

ESPnet is a speech AI toolkit for researchers and developers who want to run pretrained models on their own hardware or train speech systems. Its recipes cover data preparation through evaluation, with published results for comparison.

Photoview is a self-hosted photo gallery for photographers and families with media on a personal server or NAS. It lets you browse that collection in a web browser while keeping your existing folder organization.

OCRmyPDF makes scanned PDFs searchable and lets readers copy recognized text from them. It's a command-line tool for people digitizing paper records and developers adding OCR to document workflows.

Project Orchestrator coordinates AI coding agents for developers working across tasks or related repositories. It gives agents a shared record of code, plans and decisions so each task can draw on earlier work.

Arkitekt OpenCRM is a free, self-hosted CRM for small businesses that want lead management and email outreach on their own server. It runs in Docker with a browser dashboard and stores lead records in SQLite on the host. AI email writing is optional and can use local models through Ollama or cloud services such as OpenAI and Anthropic.

Marbor is a self-hosted AI inference gateway for operators serving models across their own GPU fleet. It places requests using live hardware and model state to reduce cold loads and avoid deployments that can't serve the requested model.

Google ADK is an AI agent framework for developers building applications that carry out multi-step tasks. Agents can run on your own infrastructure and use locally running models through adapters, or connect to hosted providers such as Gemini.

ModelScope is an AI model hub with a Python library for developers and researchers who want to run models locally or adapt them to their own data. It covers language, vision, speech, multimodal tasks and scientific computing.

Pathway's Live Data Framework is a Python framework for developers building RAG applications and analytics over changing data. It runs locally or on your own servers, including through Docker. Its incremental engine updates results as data arrives, so applications can work with changing documents and events.

AI-Researcher automates research tasks for researchers who want to develop an idea into code, experiments and an academic manuscript. It can start with a detailed proposal or use reference papers to suggest a research direction.

UltraRAG is a self-hosted framework for researchers and developers building AI systems that answer questions using their own documents. Its Python application and Docker deployment provide a browser workspace for knowledge bases, workflow design and evaluation. Generation can use local models through vLLM or Hugging Face. Embeddings can use local Sentence Transformers or a configured OpenAI service; the OpenAI cloud connection sends embedding inputs to that service.

Sim is an AI agent workspace for teams building automations and managing their use across an organization. It brings workflow creation, shared data and run monitoring into one place. You can self-host the workspace, but chat uses a Sim-managed service and requires sign-in to obtain a Chat API key.

Note Companion is an AI plugin for Obsidian users who need to sort collected notes and turn recordings into searchable material. It suits researchers, students and people with a backlog of meeting notes.

SimpleMem is a memory system for developers building AI agents that need to recall past conversations and stored media without passing the full history to a model each time.

Photonix is a self-hosted photo manager for photographers who want to find images across a large collection without relying on folder names. It combines camera metadata, your own tags and automatic image analysis to make photos searchable.

pyVideoTrans translates spoken video into another language for people preparing subtitles and dubbed versions. It works from the audio, so footage doesn't need existing subtitles.