Local & Self-Hosted AI Tools

Rhasspy 3 is an early developer-preview local voice assistant toolkit for developers building their own assistants or adding voice control to Home Assistant. The project is archived and no longer maintained. It keeps data on your computer unless you choose to send it elsewhere, and its speech components support languages beyond English.

Bolna is a voice AI agent platform for businesses handling customer support, lead qualification, reminders, and recruitment calls. Its focus is Indian languages and accents, including Hindi, Hinglish, Tamil, and Telugu, alongside English. Developers can self-host its MIT-licensed Python orchestration core, while business teams can use a hosted dashboard to build agents without code.

Seed-VC changes recorded speech or singing to sound like a voice supplied in a short reference clip, without training a separate model for that speaker. It runs locally on Windows, Linux and Apple Silicon Macs, with uses in audio production, live streaming and online meetings. The project is archived and no longer maintained.

Amurex is an AI meeting copilot that runs as a Chrome extension for Google Meet and MS Teams. It's for people who want help following a discussion and recording decisions without handling all the meeting notes themselves. You can self-host its backend and web application alongside the browser extension.

AI Render is a Blender add-on that uses your scene and a text prompt to generate an image with Stable Diffusion. It's for Blender artists who want to use their 3D work as the basis for AI images and explore different treatments within the application they already use.

so-vits-svc is an offline AI framework for changing the voice in an existing singing recording while preserving its pitch and intonation. It's aimed at developers and researchers who want to train their own singing voices, including fictional character voices. The project is archived and no longer maintained.

MCP Reference Servers is a collection of locally run examples for developers building connections between AI applications and external tools or data. Maintained by the MCP steering group, the servers demonstrate the protocol and its SDKs. They're educational implementations, so developers should assess security requirements before using them in production.

Supergateway connects MCP servers and AI clients that use different connection types. It's for developers who want to expose a local tool server over a network or connect a desktop client to a remote server. The gateway runs on your own machine or server through Node.js or Docker, and its code is open source under the MIT license.

mcp-proxy is a self-hosted tool for connecting AI clients and MCP servers that use different connection types. It's for developers who need a stdio client, such as Claude Desktop, to reach an SSE or Streamable HTTP server, or who want remote clients to access a local stdio server. The proxy runs on your own machine or server.

digiKam is a local photo manager and image editor for photographers who need to organize large collections of photos, RAW files and videos. It runs on Linux, Windows and macOS and is open-source software under GPL-2.0. Its archived GitHub mirror points contributors to the maintained KDE repository.

MindsDB Query Engine is a self-hosted server for developers building AI agents that need access to business data and documents. It queries connected sources through one SQL dialect and adds semantic search for unstructured content. You can run it locally or on your own server with Docker. Its core uses the Elastic License 2.0, with separate licenses in some directories.

Kangaroo is a desktop SQL client and database administration app for developers and database administrators who work across different database systems. It runs on Windows, macOS and Linux and includes an AI assistant for help with database problems alongside its query and design tools.

Vanna is a self-hosted Python framework for building AI agents that answer database questions in plain language. It's for teams adding chat to analytics products or internal data tools, especially when each user needs different access to the data. The project is archived and no longer maintained. Its open-source code uses the MIT license.

DeepStack is a self-hosted computer vision API for developers adding image analysis to camera systems, home automation or other applications. It runs prebuilt and custom models on your own hardware and works fully offline. Image processing stays on the device or server where you host it, with no cloud service required.

CodeProject.AI Server gives developers a shared API for AI tasks that run on their own hardware. It's a self-hosted service for adding image analysis, text processing and generation to applications. Processing stays on the machine running the server, without cloud calls or sending data outside your device or network.

OpenAgent is a self-hosted personal AI assistant that combines document search with agents that can act on your behalf. It's for people who want an assistant on their own computer or server, and teams building agents around their documents and workflows. It runs natively on Windows, macOS and Linux as a single executable. It's free and open source under Apache 2.0.

Double Take connects Frigate camera images to facial recognition services through a shared web interface and API. It's for people running camera systems and Home Assistant who want to identify familiar faces and use the results in home automations. The app runs on your own server in Docker and is open source under the MIT license.

Fooocus is a free, open-source AI image generator for people who want to create images on their own computer without spending much time tuning settings. It uses Stable Diffusion XL and automatically expands prompts with a local GPT-2 engine. Generation works offline once the required models are downloaded, so prompts and images can stay on your machine.

h2oGPT is a self-hosted ChatGPT alternative for people who want to chat with local models and ask questions about their own documents. The project is archived and no longer maintained. It's open source under Apache 2.0, with support for Linux, macOS, Windows and Docker.

Auto-Photoshop-StableDiffusion Plugin brings Stable Diffusion generation into Photoshop for artists who want to use AI alongside their existing editing tools. It connects to AUTOMATIC1111 or ComfyUI, so you can generate images within Photoshop and continue editing and saving them there.

Nougat is a local AI PDF parser for researchers and developers who need scientific papers as usable text, including their equations and tables. It converts academic PDFs into Markdown-style documents with LaTeX notation, so the output retains structure that plain text extraction can lose.

Reor is a local AI note-taking app for people who want to search their own writing, find connections between ideas and ask questions about their notes. The project is archived and no longer maintained. It runs on macOS, Windows and Linux, and it's open source under AGPL-3.0.

QAnything is a self-hosted knowledge base for people and teams who want to ask questions about their own documents, including collections that mix Chinese and English. It can answer in either language regardless of the document's language, and runs locally through Docker on Windows, macOS and Linux.

Qwen3-Embedding is a family of text embedding models for developers building search and document analysis on their own hardware or servers. It turns text into numerical representations that applications can compare by meaning. Its multilingual support covers languages including English, Chinese, Arabic and Ukrainian, as well as programming languages.

Discord Ollama Bot connects locally hosted language models to Discord, so a community can use an AI assistant inside its existing chat server. It's for server owners who want to choose and host the models themselves while keeping Discord as the interface. Model inference runs on your hardware, but conversations still pass through Discord, so this isn't a fully offline chat app.

FluxGym is a local web interface for training FLUX LoRAs on your own images, with support for GPUs with 12GB, 16GB or 20GB of VRAM. It's for people who want to customize an image model through a browser while retaining access to detailed training controls. It runs on Windows and Linux, with Docker support, and is open source under the MIT license.

Raycast Ollama brings Ollama models into Raycast on macOS and Windows, for people who want AI chat and text assistance within their desktop launcher. It connects to Ollama on your own machine or a remote server you choose. The extension is open source under the MIT license, and local inference doesn't require an Ollama API key.

Lumos is a Chrome extension for asking questions about web pages using models running on your own machine. It's for readers working through long discussions, product reviews, news articles or technical documentation who want summaries and answers tied to the material they're reading. Ollama handles inference locally, without a remote AI server.

ollama-ui is a small browser interface for people who run models through Ollama and want a graphical place to chat. You can serve the interface locally and open it in a browser, or use the Chrome extension. It's open source under the MIT license.

FlagEmbedding is an open-source Python toolkit for developers building semantic search or retrieval-augmented generation (RAG) into their own applications. It runs BGE embedding and reranking models, with tools to fine-tune both and evaluate retrieval results. The library uses the MIT license.

OpenedAI Speech is a self-hosted text-to-speech server for developers who want local speech generation in apps built around OpenAI's speech API. The project is archived and no longer maintained. It's open source under AGPL-3.0, and it generates audio on your own hardware without an OpenAI API key.

Magenta Studio brings AI music generation into Ableton Live as a Max for Live MIDI plugin. It's for producers who want to develop melodies and drum patterns within their existing Live sessions. The interface runs inside Live on your computer and works with MIDI clips in Session View.

Riffusion is a Python library for generating music and audio on your own hardware using Stable Diffusion. It's for developers and musicians who want to experiment with text-driven sound generation or build it into an app. The hobby project is no longer actively maintained.

Self-Operating Computer lets a vision-capable AI model control a desktop by reading the screen and choosing mouse and keyboard actions to carry out a goal. It's a Python framework for developers and researchers exploring AI agents that work through application interfaces. The code uses the MIT license.

LaVague is a Python framework for developers building AI agents that carry out tasks in a web browser. An agent takes a plain-language objective, examines the current page, and generates and executes browser actions across multiple steps. It's open source under the Apache 2.0 license.

Verba is a self-hosted document chatbot for people who want to ask questions across their files and knowledge bases. The project is archived and no longer maintained. It uses Weaviate to find relevant passages and gives those passages to a language model to generate answers.

NMKD Stable Diffusion GUI is a local AI image generator for people who want to create and edit images on a Windows PC. It combines Stable Diffusion generation with inpainting, LoRA training and image post-processing in a desktop interface. It's open source under GPL-3.0.

Zep Community Edition v1.0.2 is a deprecated, unsupported self-hosted memory service for developers building AI agents and conversational assistants. This legacy edition uses the Apache 2.0 license. It turns chat history into a knowledge graph that records how facts change over time, so an assistant can distinguish a user's current preferences from earlier ones.

RAGapp is a self-hosted app for teams that want an AI assistant using retrieval-augmented generation (RAG) on their own infrastructure. It pairs a browser chat interface with an admin interface for configuring the assistant, taking an approach similar to OpenAI's custom GPTs. It's open source under the Apache 2.0 license.

MindSearch is a self-hosted AI search framework for people who want to build their own Perplexity-style answer engine. Multiple LLM agents search and read web pages to produce answers with a visible research process. It's open source under Apache 2.0.

Open Deep Research is a self-hosted AI agent that searches for information and writes research reports. It's for developers and teams who want to choose their own models and research tools. The project is archived and no longer maintained.

Scira is an AI search engine for people who want answers backed by sources and control over the application they use for research. It has a hosted website, and you can self-host the open-source application under AGPL-3.0. Its live search relies on internet access and external services; self-hosting doesn't make that research offline.

STORM is an MIT-licensed, open-source research tool from Stanford OVAL that turns a topic into a Wikipedia-style report with citations. You can run its Python software on your own machine or host it on a server; Stanford also offers a hosted research preview. It's aimed at people gathering background material and writers preparing an article draft.

insanely-fast-whisper is a command-line tool for people who want to transcribe audio on their own hardware, with a focus on processing long recordings quickly. It runs OpenAI's Whisper locally on NVIDIA GPUs or Apple Silicon Macs, including support for Windows with CUDA. The project is open source under the Apache 2.0 license.

Comfy Desktop installs and launches ComfyUI on your computer, taking care of the Python environment and dependencies. You can manage several independent ComfyUI instances, each with its own version, custom nodes and settings. It suits people who want to run local image and media workflows without setting up every environment by hand.

Morphic is a self-hosted AI search engine for people who want answers backed by web sources and control over the search interface they use. It combines web searches and URL reading with AI-generated responses, so you can examine the sources behind an answer. It's open source under Apache 2.0, and you can run your own instance with Docker or use the hosted website.

Farfalle is a self-hosted AI search engine for people who want a Perplexity-style search app with a choice of local or cloud models. It combines web search with model-generated answers and includes an agent that plans and carries out searches. The code is open source under Apache 2.0.

Rivet is a desktop visual programming environment for developers building AI agents and applications with complex LLM workflows. Its editor runs on macOS, Windows and Linux, and its TypeScript library executes the resulting graphs inside your own application. The project uses the MIT license.