Local & Self-Hosted AI Tools

OpenChatCut is a local-first AI video editor for creators who want conversational editing with control over the finished cut. AI changes become editable clips, captions, effects and audio tracks in the same project you can adjust manually. It's a free, open-source ChatCut alternative under AGPL-3.0, with a desktop app for macOS, Windows and Linux.

Slotstream runs Qwen3.8-Flash-Next on Apple Silicon Macs that don't have enough RAM to hold the whole model. It's aimed at people with 16 to 64 GB of memory who want local chat, image questions or a model backend for coding agents. Most model weights stay on the SSD, while frequently used expert networks stay in memory. The full model remains available.

Handy is a free, MIT-licensed speech-to-text app for people who want to dictate wherever they type on a computer. It runs on Windows, macOS and Linux. Transcription happens locally, so your voice stays on your machine and the app can work offline.

PenEcho is an open-source workspace that puts handwritten notes, diagrams and AI-generated widgets on an infinite canvas. It runs on your computer as a macOS or Windows app, or through Node.js with a browser interface. It's for people who want to work through technical ideas visually and give AI feedback by drawing directly on the result.

Reef is self-hosted infrastructure for developers who want AI agents to improve through feedback on actual interactions. It connects inference and learning with versioned deployment, so an agent can update its model weights or its prompts, rules, and skills while continuing to serve requests. It's open source under Apache 2.0.

Phone Harness connects an AI agent to a real iPhone or Android so it can use apps through their screens. It's for developers who want Claude Code, Codex, or another agent to carry out phone tasks without a dedicated app API. The software is open source under the MIT license, and it doesn't require a jailbreak or an app installed on the phone.

Pooled runs a single open model across browser tabs on laptops, desktops and phones, combining their memory when the model won't fit on one device. It's for people who want local AI chat or a coding assistant using hardware they already have. It's open source under the MIT license and requires no account or per-device installation.

Meetily is a local AI meeting assistant for people who want meeting notes while keeping recordings on their own device. It captures calls from Zoom, Google Meet, Microsoft Teams and other meeting software without placing a bot in the meeting. You can watch the transcript appear during the call, then generate a summary.

CozyClay is a local 3D previsualization studio for filmmakers and AI video creators who want to plan framing and movement before generating a finished clip. You build a rough scene, pose characters, and edit camera moves and cuts on a timeline. Those shots become visual references for models such as Seedance, Kling and Veo, so you can specify the camera through a clip rather than relying on text alone.

ripwire helps AI coding agents find relevant code and assess changes without filling their context with whole files. It runs offline on your machine as a self-contained binary, with a CLI and an optional MCP server. It's for developers who want their agents to spend less context on repository research and check the effects of their edits.

Tel-Agent is a self-hosted AI receptionist for businesses that want phone calls and customer messages handled in one place. It runs on your own hardware and keeps recordings and searchable transcripts on your machine. It's free and open source under the AGPL-3.0 license.

Karakeep is a bookmark manager for people who collect links, notes, images and PDFs in one place. You can run the open source app on your own server with Docker under the AGPL-3.0 license, or use the managed Karakeep Cloud service. It has a web app, iOS and Android apps, and extensions for Chrome, Firefox and Safari.

deja-vu gives coding assistants a shared memory of work already recorded on your machine. It searches sessions from before you installed it, so developers can recover an old fix or carry context between Claude Code, Codex CLI, Cursor and opencode without starting a separate collection of notes.

Wan2GP brings video, image, music and speech generation to your own computer, with particular attention to GPUs with limited memory. It's for creators who want several media models in one browser interface. The project builds on Wan-Video/Wan2.1.

Bifrost is a self-hosted AI gateway for developers and teams whose applications use multiple model providers. It puts Ollama, custom model deployments, and cloud services behind one OpenAI-compatible API, so applications can switch models without maintaining a separate integration for each provider.

SurfSense is an open-source NotebookLM alternative that turns documents into cited answers and editable deliverables on your computer. It's a desktop app for Windows, macOS and Linux, aimed at people working with confidential files, research or study material. You don't need an account.

agentacct is a local dashboard for developers who want to review what their coding agents did across projects and compare usage with recorded results. It brings task activity, file changes and test outcomes together with token counts and estimated costs. Claude Code and Codex have the fullest task records; it also supports OpenCode, Kimi Code and Hermes, with coverage varying by capability.

Pipecat is a Python framework for developers building conversational AI agents that handle speech, video, text, and images. You can run it on your own machine or servers, wherever Python runs. It's open source under the BSD 2-Clause license.

AIRI is a self-hosted AI companion for people who want a virtual character they can talk to and play games with. Inspired by Neuro-sama, it combines real-time voice conversation with game integrations for Minecraft and Factorio. The project is in early development; Factorio support is a work in progress with a proof of concept. It's open source under the MIT license.

DiffSynth-Studio is a Python diffusion model engine for developers and researchers who want to generate media and train models on their own hardware. It supports large models on consumer GPUs through memory offloading and quantization, with inference and training in the same framework. It's open source under Apache 2.0.

Graphiti is a self-hosted Python framework for developers building AI agents that need to remember changing facts. It builds knowledge graphs from conversations, structured records and unstructured text, so an agent can query current information or recover what was true earlier. It's open source under Apache 2.0.

VoiceInk is a native macOS dictation app for people who want to write emails, notes, and AI prompts by speaking. It transcribes speech locally and works across applications, so writers, students, and developers can dictate into the apps they already use. Voice transcription works offline.

exo is a local LLM runner that combines your devices into a cluster, letting you use models too large for one machine's memory. It's for people who want to run large models on their own hardware and developers connecting existing AI clients to local inference. It runs on macOS and Linux under the Apache 2.0 license.

LibreTranslate is a self-hosted machine translation API for developers and organizations that want to run translation on their own servers. It's free to download and can work offline. The project is open source under the GNU Affero General Public License v3.0 (AGPL-3.0).

Sim is an AI agent workspace for teams that need to build automations and control how people use them across an organization. You can self-host it on your own server or cloud with Docker or Kubernetes. Its open-source code uses the Apache 2.0 license.

Jan gives people a ChatGPT-style chat interface for AI models running on their own computer. It's free and available for Windows, macOS and Linux. Local chats work offline, with the model and conversation kept on your machine. You can also use cloud models when you want access to a hosted provider.

Mastra is a TypeScript framework for developers building AI agents and applications on their own servers or inside existing web apps. Its server runs locally or as a standalone deployment; Mastra Cloud provides a hosted alternative. Model routing connects to providers such as OpenAI, Anthropic, and Gemini, so running the framework locally doesn't keep those model requests on your machine.

OpenClaw is a self-hosted AI assistant that connects your own computer to the messaging services you already use. It's for people who want a personal assistant on their laptop, or teams that want to run a shared assistant on their own hardware. The project is open source under the MIT license.

Home Assistant Assist is a voice assistant for people who want to control their smart home through natural language while keeping voice processing on their own hardware. It's built into Home Assistant, which runs on a Raspberry Pi or a local server and is open source under Apache 2.0.

Firecrawl helps developers give AI agents and applications access to current web content. It searches for pages, extracts their contents, and returns data in forms an application can use. The project is open source under AGPL-3.0 and can run on a self-hosted server. Firecrawl also offers a hosted service that requires an account and API key and includes additional features. Reaching live websites requires an internet connection.

AnythingLLM is an open source AI assistant for people who want to chat with their documents and use AI agents on their own hardware. The desktop app runs on Windows, macOS and Linux, while a Docker deployment supports multiple users on a self-hosted server. No account is required for the desktop app.

Langflow is a visual builder for developers creating AI agents and retrieval-augmented generation (RAG) applications. You can run it locally or on your own server, with Docker support and desktop apps for Windows and macOS. The open-source software uses the MIT license. A hosted cloud offering provides a separate deployment option.

Superpowers adds a structured development process to AI coding assistants. It's for developers who want their agent to agree on a design before writing code, follow an implementation plan, and check its work against that plan. The open-source framework uses the MIT license and works inside coding tools including Claude Code, Codex, Cursor, Gemini CLI and OpenCode.

Onyx is an AI search and chat platform for teams whose information is spread across workplace apps. It indexes company knowledge so employees can ask questions across sources and get answers grounded in relevant documents. Teams can deploy it in their own cloud or on bare metal, including an air-gapped environment.

Ente Photos is a Google Photos alternative for people who want encrypted photo backups and AI search without giving a storage provider access to their library. You can use its hosted service or self-host the server. Face detection, grouping and natural-language search run on your device; the hosted service stores your encrypted backups.

Qdrant is a self-hosted vector database for developers building semantic search, retrieval-augmented generation (RAG), recommendations and AI agent memory. It stores embeddings alongside JSON metadata, so applications can find similar content while restricting results by attributes such as location, text or numeric ranges. The Rust engine is open source under Apache 2.0 and runs locally in Docker or on your own servers.

vLLM is an open source engine for serving large language models on hardware you control. It suits developers and teams that need to handle many requests through an API while making efficient use of memory and compute. It's licensed under Apache 2.0 and can run with GPUs or on a CPU.

GPT Researcher is a self-hosted AI research agent for people who need detailed, cited reports drawn from the web, their own documents, or both. You choose the language model and search provider, and can run the software on your own server or through Docker. It's open source under Apache 2.0.

OpenCode is a free, MIT-licensed AI coding agent for developers working in a terminal, IDE, or desktop app. The desktop app runs on macOS, Windows, and Linux, with support for both Apple Silicon and Intel Macs. It can use local models, giving developers a way to run the model on their own hardware.

Diffusers is an open-source Python library for developers and researchers who want to run diffusion models on their own hardware or build generation features into an application. It uses PyTorch and supports image, video and audio generation. The library is licensed under Apache 2.0 and supports Apple Silicon.

LightRAG combines knowledge graphs with vector search to answer questions across a document collection. It's a self-hosted Python framework for developers building document assistants, particularly where answers depend on relationships between facts in different files, such as legal or financial material.

LibreChat is a self-hosted ChatGPT alternative for people and teams that want local models and cloud AI services in one chat interface. It runs on a server you control and is open source under the MIT license. You can switch models without moving to a separate chat app.

SD.Next is a self-hosted web interface for artists, researchers and people who want to generate and edit images or videos on their own hardware. It builds on Automatic1111 WebUI's original codebase and supports Stable Diffusion alongside other diffusion models. It's open source under Apache 2.0.

SearXNG is a self-hosted metasearch engine for people who want web search without user tracking or profiling. It brings results from separate search services into one browser interface. You can run your own instance or use a public one, depending on who you want to trust with your searches.

Dify is a source-available platform for teams building AI agents and apps on a visual canvas. Its Community Edition runs on your own server with Docker. Dify also offers a hosted cloud service, while Enterprise deployments can run in a VPC or on a self-hosted server. The Community Edition uses a custom Apache 2.0 derivative license.

Crush is a terminal AI coding assistant for developers who want to work with their code and tools through a model they choose. The app runs on your machine, while model requests go to your selected local backend or cloud provider. It supports macOS, Linux, Windows (PowerShell and WSL), Android, FreeBSD, OpenBSD and NetBSD.

Opik is an open-source LLM observability and evaluation platform for developers building AI agents and RAG applications. Its Apache 2.0 licensed platform can be self-hosted on your own hardware or servers; Comet also offers a hosted service. Self-hosting lets teams keep their observability deployment in their own environment.

Agno is a Python framework and runtime for developers building customer-facing or internal AI agents. You can run its agent platform locally with Docker, on your own servers or in your cloud. The open-source framework uses the Apache 2.0 license, and the platform keeps sessions, memory, knowledge and traces in your database.