Local & Self-Hosted AI Tools

OwnPilot is a self-hosted AI assistant for people who want personal records and agents that can carry out tasks in one web interface. It supports local model backends as well as cloud providers.

Mochi 1 generates video from written prompts for creators and developers who want to run a video model on their own hardware or adapt it to their own footage.

whisper.cpp runs OpenAI's Whisper speech recognition models on your own hardware. It's for developers adding transcription to applications and people who need offline speech-to-text.

Strix is an AI penetration testing tool for developers and security teams assessing code, web applications and APIs. Its free, open source edition runs locally with Docker under the Apache 2.0 license. It supports local models through Ollama or LM Studio, as well as remote providers such as OpenAI and Anthropic; cloud-backed runs send model requests to the selected provider.

Libre WebUI is a self-hosted AI workspace for individuals and teams who want chat, document research and AI agent tasks on infrastructure they control. You can use local models or connect a remote provider of your choice.

BentoML is a Python framework for developers who want to turn AI models into services on their own hardware or servers. It handles model serving and application logic for LLMs, image generation, audio, and embeddings.

Wyoming Piper provides local speech generation for Home Assistant and other Wyoming-compatible clients. It's for people building a voice assistant who want speech synthesis to run on their own machine or server.

QM is a self-hosted AI agent platform for startups that want employees to work with agents individually and in shared channels or projects. Each person and room has its own memory, files, permissions and persistent workspace.

PocketPal AI runs language models on phones and tablets for people who want an assistant they can use without sending conversations to a server. Core chat works offline after a model download and doesn't require an account.

Cognee gives AI agents memory across sessions so they can reuse project context, decisions, and lessons from earlier work. It's for developers building agents and teams whose knowledge sits across documents, code, and conversations.

Kilo Code is an AI coding assistant for developers who want an agent to edit, explain, and debug a codebase in their editor or terminal. You can choose local models, connect a provider with your own API keys, or use Kilo's hosted model access.

NullHub is a self-hosted management console for people running NullClaw and its supporting tools. It brings agent instances, workflow runs and task queues into one browser dashboard.

Silero VAD is a pretrained voice activity detection model for developers who need to find speech segments in audio. It returns speech timestamps for use in audio processing pipelines.

LLM Farm is an app for on-device AI conversations and comparing language models on Apple hardware. It suits people who want offline chat or need to assess which model fits a project.

ZeroClaw is a personal AI agent for people who want an assistant running on their own computer or server. It can use a shell and browser, respond through messaging apps and perform scheduled tasks.

Open Generative AI is an AI image and video studio for creators who want to generate media on their own hardware. Local inference is available only in the desktop app.

OpenVoiceOS is a voice assistant platform for people building smart speakers or adding voice control to their own devices. Its core is a fork of MycroftAI/mycroft-core, and most classic Mycroft skills remain compatible.

FastSurfer processes structural human brain MRI scans on your own workstation or server, producing brain segmentations and cortical measurements compatible with FreeSurfer. It's for neuroimaging researchers working with individual scans or large cohorts who want shorter processing times within existing analysis workflows. The software is open source under Apache 2.0.

OpenCommit is a command-line tool for developers who want AI to write commit messages from their Git changes. It can create the commit after you review the proposed message and also fits into an IDE's existing Git workflow.

SQL Chat is a SQL client for people who want to work with databases using natural language. Its chat interface lets you ask for data and request database changes without writing every SQL statement yourself.

Hatice is a self-hosted coding agent orchestrator for developers who want agents to work through issue-tracker tasks. It assigns issues to Claude Code agents and manages work across multiple turns.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

TabbyAPI is a self-hosted LLM API server for people who want to run ExLlamaV3 models on their own hardware. It’s built for personal projects and small groups; its maintainers don’t recommend it for production servers.

RAGatouille is a Python library for developers building retrieval-augmented generation (RAG) applications with ColBERT. It builds and searches document indexes on your own hardware or server, with compressed indexes stored on disk that your application can query directly.

LangGraph is an AI agent framework for developers building applications on their own machines, including workflows that use local models through LangChain's ChatOllama integration. Ollama can run models such as gpt-oss locally. LangGraph also works with remote model providers, so where model requests go depends on the connection your application uses.

Agent S is a computer-use AI agent framework for developers and researchers building desktop automation. It takes natural-language tasks and operates desktop and web applications through their screen interfaces, without requiring an API integration for each app.

ProPainter is an AI video inpainting tool for people who need to remove unwanted objects or fill missing areas in footage. It processes videos with masks that identify the regions to replace.

Spleeter is Deezer's music separation library for developers and audio researchers who want to extract individual parts from a recording on their own hardware. Its pretrained models let you process music without training a model first.

Tonfotos organizes family photos and videos for people whose collections span a computer, external drives and a NAS. It helps you find pictures of relatives and keep family history alongside the archive.

Fast Agent is a terminal coding assistant and Python toolkit for developers building AI agents and automated workflows. You can choose local LLMs or hosted providers and use the same toolkit for interactive work, scripting, and evaluation.

SpeakoFlow lets you dictate into other apps and ask an AI assistant for help without leaving your work. It's for people who want voice typing, spoken conversations and meeting notes with processing on their own computer.

Waves Clarity Vx DeReverb is a proprietary neural audio plug-in for reducing room reverberation in recorded speech and singing. It is for music producers, podcast creators and dialogue editors who need to reduce unwanted acoustics while retaining the vocal performance.

Revornix is an AI knowledge workspace for people who collect articles, research papers and recordings and want to ask questions across their library. It connects saved material in a personal knowledge graph and uses those relationships to inform its answers.

Nexent is a self-hosted AI agent platform for people and teams who want to build agents by describing tasks in plain language. It generates executable agents without requiring code or a visual workflow editor.

Kokoro Clipboard TTS reads selected or copied text aloud on Windows and macOS using Kokoro-82M. It's for people who want to listen to text across desktop apps while keeping it private. Speech generation works offline, and both clipboard text and audio stay on your machine. It doesn't require an account or API key, and it has no telemetry.

SapienAI is an academic chatbot and research workspace for researchers who want to keep source material, writing and AI conversations together. Research spaces group project documents, notes and drafts so the AI can answer questions using uploaded material.

opencodex is a local AI gateway for developers who want to choose which models power their coding assistants. It connects Codex, Claude Code, Claude Desktop and Grok Build to alternative providers while keeping each tool's native interface.

RAG Web UI is a self-hosted app for asking questions about your own documents. It's a learning project, and its maintainers advise against commercial use and state that it isn't ready for production.

Podcastfy turns source material into podcast-style audio conversations for creators and developers. It's an alternative to NotebookLM's podcast feature for people who want to customize the conversation or include podcast generation in their own software.

audio.cpp runs audio models locally for developers building speech tools and people generating or processing audio on their own hardware. It brings multiple audio tasks into one C++ runtime built on ggml.

Flawless provides CISRE, a self-hosted AI SRE platform for teams investigating Kubernetes incidents. It connects evidence collection and diagnosis with approved changes and checks that the affected resource has recovered.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

Stagehand is an open-source browser agent SDK for developers automating websites and collecting structured data in local Chrome. Model inference is separate from browser execution: direct provider calls send model context remotely, while a custom callback can connect a self-hosted model. Local runs require Chrome.

Memo AI turns audio and video into transcripts, translated subtitles and notes for people reviewing interviews, meetings or podcasts. Speech recognition works offline, and speaker identification runs locally.

Microsoft Agent Framework is an AI agent framework for developers building locally hosted applications in Python or C#/.NET. It supports local development and self-hosting of the application, while integrations such as Azure OpenAI and OpenAI send model requests to those providers. Self-hosting the app doesn't make those calls offline or remove provider costs.

ccusage is a local command-line tool for developers who want to see how many tokens their coding agents use and what that usage costs. It reads the agents' local usage records, so you can compare activity across tools in one place.