Self-Hosted AI Tools You Can Run in Docker

agentmemory gives AI coding agents persistent, searchable context from earlier work. It's for developers who want project decisions, past errors and useful lessons to remain available across sessions and different agents.

Cog packages machine learning models for researchers and developers serving them on their own infrastructure. It handles the container environment and inference API around a Python model.

VoiceStudio is a local AI voice studio for creators who need speech generation and audio production without uploading their recordings. It combines voice creation, video dubbing and longer spoken projects in one application.

llmfit helps people choosing models for their own computers compare what will fit in memory and how fast it might run. It checks your hardware before recommending models, so you can assess candidates before downloading them.

Firecrawl turns web pages into content that developers can use in AI apps and agents. Its self-hosted API suits teams that want to collect web data on infrastructure they control.

OpenFlowKit is a diagram editor for developers who need to explain software architecture or understand an existing codebase. You can draw directly, work in text, or let an AI agent edit the same canvas.

Obscura is a headless browser engine for developers building AI agents and web scraping systems with many independent sessions. Each session starts with fresh state, keeping cookies, logins and cached data separate between tasks.

HyperFrames turns web layouts and animations into videos for developers and teams building automated video workflows. It uses plain HTML and CSS, so you can create compositions yourself or work with an AI coding assistant without adopting React.

Scrapling is a Python web scraping framework for developers collecting data from individual pages or crawling whole sites. Its adaptive parser can relocate selected elements when a website's layout changes.

FreeLLMAPI gives developers one API for experimenting with cloud models and local backends. The router runs locally, but cloud inference still sends requests to the providers you enable.

MoneyPrinterTurbo is a self-hosted AI video generator for creators producing shorts from topics or keywords. It automates the production workflow while letting you supply your own content at each stage.

OpenDataLoader PDF is a PDF parser for developers building document search and retrieval-augmented generation systems. It preserves document structure and source locations so applications can retrieve passages and point readers back to the original page.

DeepTutor is a self-hosted AI tutor for learners who want to study their own materials through a browser or CLI. It supports Docker deployment and uses configured model providers for its AI capabilities. Hosting the app locally is separate from model inference; requests to a remote provider leave the host.

Repomix packages repositories into a single file for developers who need to give an AI assistant project context for code review or analysis. It works with local directories and remote repositories.

OpenConnector connects AI agents to users' app accounts. It's for developers whose agents need reusable access to work tools while keeping provider credentials outside the agent process.

Hermes Agent is a self-hosted AI agent from Nous Research for people who want an assistant that remembers past work and handles recurring tasks. It runs on macOS, Linux and native Windows, or on a server you control. Model connections include Nous Portal, OpenRouter, OpenAI and your own endpoint; choosing a hosted provider sends model requests to that service.

OmniRoute is an AI gateway for developers who want their coding assistants and other AI clients to share one set of provider connections. It routes requests across models and accounts when a service fails, reaches a rate limit or runs out of quota.

LangWatch helps AI teams test agent behavior before release and investigate production failures. Teams can reproduce a failed conversation and check how an agent handles it again.

vLLM serves language models on hardware you control. It's for developers and teams building model APIs that need to handle concurrent requests while using memory and compute efficiently.

FalkorDB is a self-hosted graph database for developers building GraphRAG applications and AI agents that retrieve connected facts. It stores entities, relationships and their attributes, with Cypher queries and vector search for finding relevant information. Docker runs the database on your own hardware; a separate hosted cloud service is also available.

Supergateway connects MCP tool servers to AI clients that expect a different connection type. Developers can expose a local server over a network or make a remote server accessible to a desktop client.

LightLLM is a self-hosted LLM inference and serving framework for developers and teams running models on their own GPU servers. Its focus is serving requests efficiently: it schedules work around predicted memory use and handles text encoding, model inference and output decoding asynchronously to improve GPU utilization.

AIClient2API is a self-hosted AI API proxy for developers connecting chat apps and coding assistants to multiple model providers. It exposes services such as Antigravity, Codex, Grok, and Kiro through interfaces those apps already support.

text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.

My Virtual Office gives people running AI agents a visual way to follow their work. Agents appear as characters in a retro 2D office, so you can see who's active without relying only on logs.

Exo Agent Framework is for developers building long-running AI agents that can revise their own code, tools and prompts. It preserves agent identity and history as their behavior changes across runs.

Kiro Crew is a self-hosted AI development workspace for developers who want agents to keep working between conversations. It runs on your computer or a server you control, but its default kiro-cli backend requires separate Kiro sign-in for model access. The default Kiro connection sends model requests to Kiro's cloud service, powered by Amazon Bedrock.

localGPT is a self-hosted document chat app for people who want to ask questions about files and summarise them on their own hardware. Its local processing keeps document content and chat data on the machine running the app.

SilverBullet is a knowledge workspace for personal notes, shared wikis and project documentation. It keeps your writing in plain Markdown files and lets you build connections and collect information across pages.

xberg, formerly Kreuzberg, is a local document extraction engine for developers building AI search and document processing applications. It turns files into text and structured content that those applications can use.

HomeGallery is a self-hosted photo and video gallery for people browsing a personal media archive without reorganizing their files. It's designed for a single user with some technical knowledge. By default, AI discovery sends preview images to a public analysis API; you can host that API locally instead.

MTEB helps researchers and developers compare embedding models and retrieval systems for the tasks they need. Its benchmarks cover multiple languages and modalities.

Demucs separates mixed music recordings into parts for musicians who want to work with individual instruments or vocals. The author maintains a separate repository, with no active feature development and slow responses expected.

TensorRT is NVIDIA's inference toolkit for developers deploying AI applications on NVIDIA GPUs. Its compilers, runtimes and model optimizations target lower response latency and higher throughput on local machines, self-hosted servers and edge devices.