Local & Self-Hosted AI Tools

Lunary is an LLM observability and prompt management platform for teams building AI agents and chatbots. It helps developers investigate production errors and review how people interact with their applications.

ZoneMinder is a self-hosted CCTV system for people who want to manage security cameras on their own Linux machine. It handles camera video capture, analysis, recording and monitoring.

FunASR is a speech-to-text toolkit for developers building transcription services and voice applications. It supports offline recordings and live speech on local hardware or self-hosted servers, with capabilities that depend on the model and runtime.

Scrypted connects home cameras to smart home apps and displays with low latency video streams. It's for people who want to use their cameras across different home systems or add recording through its NVR plugin.

AgentsMesh coordinates AI coding agents across local machines and servers for developers managing concurrent work. A shared console lets teams assign tasks, watch terminals and follow progress across agents.

Dia generates spoken English conversations from a written script. It's for developers and researchers who want to produce two-speaker dialogue on their own hardware, with audio references to guide the voices and delivery.

Vosk is an offline speech-to-text toolkit for developers building voice interfaces or transcription software. It processes speech on the device or server running it, without sending audio to a cloud recognition service.

BrowserPilot is a Python browser automation agent for developers who want to describe web tasks in plain English. It controls Chrome through Selenium on your machine, or a remote browser through Selenium Grid. The software is open source under the MIT license, but its AI capabilities use OpenAI's cloud API and require an API key and internet access.

Dolphin Document Parser converts PDFs and document images into structured content for developers working on document extraction. It handles digitally created and photographed pages, including documents that mix text with tables, formulas, and code.

Distilabel is a Python framework for engineers building synthetic datasets and model-generated feedback with local LLM backends such as Ollama, llama.cpp and Hugging Face Transformers. It also connects to cloud services, including OpenAI and Anthropic; requests through those integrations go to the remote provider. Where inference runs depends on the backend you choose.

Serena gives AI coding agents tools to work with functions, classes and the relationships between them. It's for developers who want an agent to locate and change specific code without reading every file in full.

Codewhale is a coding assistant for developers who want an agent to inspect projects, make changes and check the results. It runs on your computer and lets you choose the model and the permissions it works under.

Codanna helps developers and AI coding agents explore a repository and assess which code a change could affect. It connects code search with function relationships, so an assistant can get context around a match in one response.

AFFiNE is a local-first knowledge workspace for individuals and teams who want documents, visual plans and databases together. It keeps workspace data on your disk and supports self-hosted servers through Docker. Optional AI features assist with writing and visual work alongside the local workspace. Optional AI in self-hosted workspaces requires your own provider keys; cloud provider requests go to that service.

sonible prime:vocal is a proprietary desktop AI audio processor for singers, producers and editors who need to repair vocal or speech recordings before mixing. Its processing is trained specifically for vocals, with tools for cleaning up phone recordings, home demos and dialogue captured in untreated rooms.

Enchanted is a ChatGPT alternative for people who want an Apple app for chatting with models they host themselves. It requires your own Ollama server, which runs the models on your computer or a server you control.

GPT-NeoX is EleutherAI's framework for researchers and teams training language models with billions of parameters on their own GPU infrastructure. It focuses on training from scratch, with support for fine-tuning existing checkpoints.

SWE-agent is a command-line coding agent for developers and researchers attempting fixes in GitHub repositories. It runs the agent on your machine and supports local Ollama models through a configured endpoint, or cloud APIs such as OpenAI and Anthropic. Cloud-backed runs send model requests to the selected provider.

SkinTokens is an AI rigging project for 3D artists and researchers preparing meshes for character animation or simulation. Its TokenRig model generates a skeleton hierarchy and the skin weights that control how the mesh moves with its bones. Local inference requires an NVIDIA GPU with at least 14 GB of memory.

NativeMind is a local ChatGPT alternative for people who want AI help with reading and writing inside their browser. It processes prompts and page content on your device using local models.

NVIDIA Container Toolkit lets developers and server operators build and run containers that use NVIDIA GPUs. It provides GPU access for containerized applications on a Linux machine or server.

DevSpace is a self-hosted MCP server for developers who want ChatGPT, Claude or another compatible client to work in projects on their own machine. It connects an assistant to selected local folders and the project's terminal tools.

Tracely helps developers trace AI agents and turn production failures into tests that catch the same problem before another release. It uses recorded runs as test cases, so teams can build regression coverage from failures their agents have actually encountered.

ASUS MuseTree is an on-device AI image creation app for designers and people developing visual concepts. It works offline and brings prompts, sketches and reference images into a workspace for exploring and saving ideas.

Atomic Agent is a local AI agent for people who want an assistant to work with their browser, files and code on their own hardware. Its model and task loop can run offline, while sessions and memory stay on disk. It's free and open source under the MIT license.

ShellGPT is an AI terminal assistant for developers and others who want help writing commands and code without leaving the shell.

HunyuanImage is Tencent's text-to-image model for people who want to generate images on their own hardware. It handles detailed scene descriptions, including requests for lettering within an image.

Layla is an AI assistant for people who want private chat, a personal companion or character roleplay on their phone. It runs local models on Android and iOS, so you can keep using it offline after downloading a model.

MDFlux is a desktop app for turning documents into structured Markdown for AI workflows, research, or text editing. It suits people who need usable text from mixed files and scanned archives while keeping conversion on their own machine.

WhisperSubTranslate is a free desktop app for creating translated SRT subtitles from video speech. It's for people who want to subtitle videos on their own computer, with offline transcription and translation after downloading the models.

Memvid gives AI agents persistent memory in a portable file. It's for developers who need agents to recall conversations or search documents without running a separate database server.

Colossal-AI is a Python framework for developers and researchers training or serving large AI models on their own GPUs. It provides tools to spread workloads across GPUs and work within available memory.

Raycast's AI assistant lets you chat with models running through Ollama on your computer. It's for people who want local AI conversations within Raycast's existing chat and command tools.

Docspell is a self-hosted document organizer for households and small organizations that need to find files collected from scanners, email and other sources. It uses extracted text to help reduce manual labeling.

LabelMe is a desktop image annotation app for people preparing computer vision datasets. It combines manual drawing with model assistance for labeling objects and outlining image regions.

KeyBERT is a Python library that extracts keywords and phrases by comparing their meaning with the document they come from. It's for developers and researchers who want to add keyword extraction to text processing projects without training a model from scratch. The library is open source under the MIT license.

Open Interpreter is a locally installed terminal coding agent for developers on macOS, Linux and Windows. It's a fork of OpenAI's Codex that focuses on adapting agent behavior to lower-cost models. Commands run on your computer inside native sandboxing; model requests go to your selected provider, so local installation alone doesn't mean local inference.

Aider is a terminal coding assistant for developers who want an LLM to make changes in a new or existing project. It works with local models and cloud services, and keeps code edits reviewable through Git.

Surf is an AI notebook for people researching across webpages, videos and documents. It brings source material and writing into one workspace so you can ask questions about what you've collected while taking notes.

LLPhant is a PHP framework for developers adding AI capabilities to Symfony and Laravel applications. It supports local model services and cloud providers, so you can choose where model requests run.

NVIDIA DCGM monitors and manages NVIDIA data-center GPUs for infrastructure teams running GPU clusters. It helps teams investigate slow jobs, detect hardware problems and control GPU power and clock settings.

Chat2DB Community is a free local database client for developers, database administrators and analysts who want AI assistance beside their SQL editor. It runs on Windows, macOS and Linux, or in Docker with browser access. You connect your own AI model; where AI requests go depends on that connection, so the local app alone doesn't guarantee local inference.

pgvectorscale extends pgvector for developers who want to search large embedding datasets within PostgreSQL. It adds indexing and compression for AI applications that keep vector data in their existing database.

lm-evaluation-harness is a Python framework for researchers and developers comparing language models on shared benchmarks. Public prompts help make results comparable across model checkpoints and research papers.

Fish Speech is a self-hosted text-to-speech system for creators producing narration and developers building voice applications. Its S2 Pro model supports directed speech delivery and dialogue with multiple speakers.

Spark-TTS is a local text-to-speech system for developers and researchers building speech applications. It can reproduce a voice from reference audio or create a synthetic speaker with chosen vocal traits.