Self-Hosted AI Tools You Can Run in Docker

Helix is a paid, self-hosted platform for engineering teams coordinating coding agents. Agents work on separate tasks in parallel, while the team shares a view of their progress and reviews their work.

TradingAgents is an open-source Python framework for researchers and developers studying AI trading decisions. It assigns market analysis and risk assessment to separate LLM agents, then combines their findings into a proposed trade for a simulated exchange.

big-AGI is a browser-based AI workspace for developers, researchers and people who need to compare answers across models. It lets you examine separate responses and combine them while keeping control over model choice and reusable context.

Deepchecks is a Python toolkit for data scientists and ML teams checking datasets and models before deployment and watching for problems in production. Its testing, CI and monitoring components reuse the same checks across those stages.

NeMo Automodel is a Python library for researchers and developers who want to train or adapt AI models on their own GPU workstations or clusters. Its PyTorch-based training works with Hugging Face models without converting checkpoints.

PentAGI automates authorized penetration testing for security engineers, researchers and red teams. Its specialized AI agents turn a target and a plain-language goal into testing work you can follow through a web interface.

MiniRAG is a Python framework for developers building question-answering tools over their own data with small language models. It targets on-device applications where larger models and heavier retrieval systems are difficult to use.

MonkeyOCR is a local AI document parser for developers and researchers who need to extract content from English and Chinese PDFs or images. It recognizes page structure and reading order alongside the content itself.

RisuAI is an AI roleplay client for people who want to create characters and fictional worlds, then develop stories through conversation. It supports chats with individual characters or groups.

ChatFiles is a self-hosted document chatbot for people who want to question their uploaded files in a browser. The application runs locally, while its GPT integration makes remote API calls. Document chat also requires a Supabase vector database.

Infinity is a search database for developers building retrieval-augmented generation (RAG), question answering and recommendation systems. It lets applications combine matches based on meaning with exact text matches and structured filters.

LazyLLM is a Python framework for developers building applications with multiple AI agents. It brings application workflows, model training and evaluation together so teams can refine a prototype using task-specific data.

Weaviate is a vector database for developers building search, recommendation and RAG applications. It stores data alongside embeddings so applications can retrieve related content and apply structured filters.

SenseVoice is a local speech recognition model for developers building voice apps or analyzing recordings. Its SenseVoiceSmall model adds information about the language, emotion and surrounding sounds to speech transcriptions.

PandasAI is a Python library that executes data analysis code in your environment and lets analysts ask questions in plain language. It can isolate that execution in Docker. Its documented LiteLLM integration uses OpenAI's gpt-4.1-mini, so model requests go to a cloud service and require an API key.

Open Instruct is AllenAI's toolkit for researchers and developers adapting pretrained language models with public datasets. It includes the training recipes behind TÜLU and downloadable checkpoints for comparing training stages.

AgentSight is a local AI agent monitoring tool for developers investigating failed runs, slow steps or unexpected changes. It connects prompts and model calls to what agents actually do on the machine, including activity their own logs may miss.

Aiursoft Ollama Gateway gives teams controlled access to shared local LLM servers. It connects AI applications and coding assistants to Ollama or OpenAI-compatible backends through a central gateway.

OpenUI is an AI UI builder for developers prototyping web components. Describe an interface in plain language, inspect the rendered result, and ask for changes before taking the code into a project.

AI Infra Guard is a self-hosted AI security testing platform for developers and security teams checking agent workflows, model responses and AI infrastructure. It combines vulnerability scans and adversarial prompt tests in a web interface.

Nerfstudio is a 3D reconstruction framework for researchers and developers turning photos or phone video into scenes they can view from new angles. It supports model training, testing and inspection within one Python framework.

icefall is a speech model training toolkit for developers and researchers building recognition systems on their own hardware. Its Python recipes use k2 and lhotse to train, fine-tune, and evaluate models across speech datasets.

jetson-containers is a Docker container build system for developers running local AI on NVIDIA Jetson. It assembles GPU software and its dependencies into containers for workloads that need a compatible CUDA stack.

OpenContracts is a self-hosted document intelligence platform for teams working with legal archives, research libraries or internal policies. It connects documents through citations and annotations, giving people and AI agents a shared record of how source material relates. The code is open source under the MIT license; the public website also provides collections readers can browse.

txtai is a Python framework for developers building search, chat with their data, and AI agents on their own hardware. It combines a searchable knowledge store with model workflows, so applications can retrieve context and act on it.

Amphion is an audio generation toolkit for researchers and engineers developing speech and singing systems. It brings model implementations, dataset preparation and evaluation into one research codebase.

subgen creates subtitles from audio and video for personal media libraries. It's useful for films and shows that lack usable subtitles, with automatic generation tied to your media server.

DeepFace is a Python library for developers adding face recognition and facial analysis to applications. It brings several recognition models behind a shared interface and handles the image preparation needed to compare faces.

FastGPT is an AI agent builder for teams creating document-based assistants and business workflows. It suits internal knowledge search, customer support and applications that combine answers with actions.

Laminar helps developers inspect AI agent runs, find recurring failures and test fixes. It connects production traces with debugging and evaluation tools.

JoyCaption generates image descriptions for people preparing datasets to train or fine-tune diffusion models. It can caption images on your own GPU, reducing the work of writing training descriptions by hand.

NoteGen is an AI note-taking app for collecting research, meeting material and ideas before organizing them into finished documents. Notes remain ordinary Markdown files, with attachments stored on your device by default.

Qdrant is a vector database for developers building semantic search, retrieval-augmented generation (RAG), recommendations and AI agent memory. It stores embeddings with metadata so applications can find similar items within a relevant subset of their data.

ebook2audiobook converts non-DRM ebooks into narrated audio with chapters and metadata. It's for readers who want audio editions of legally acquired books, with a choice of speech engines and narrator voices.