Local & Self-Hosted AI Tools

DeskTranslate translates text visible in games, videos, menus and images for people who want to read it without switching applications. It can translate a single selection or follow changing dialogue in a chosen screen region.

Promptfoo is an open source CLI and library for developers and security teams evaluating AI applications on their own machine. It supports local models through Ollama alongside cloud providers. Evaluations run locally, but tests against cloud models send requests to those providers, and most require an API key.

Qwen3 is a language model family from Alibaba Cloud's Qwen team for people building chat applications or running models on their own hardware. Its public weights include dense and mixture-of-experts models in smaller and larger sizes.

II Agent is an AI agent for developers and teams who want an assistant to carry out research, build applications and handle documents. It can act through a browser, shell and files to complete tasks that need several steps.

AnimateDiff generates animations with personalized Stable Diffusion models for artists and developers who want motion in their chosen visual style. Compatible image models don't need separate animation training.

Nunchaku is a local diffusion inference engine for developers and image-generation users who want to run models such as FLUX with less GPU memory. It focuses on faster generation with compressed models on NVIDIA hardware.

pyannote.audio is a Python toolkit for developers and researchers who need to separate recordings by speaker. Speaker diarization identifies who spoke when, so applications can associate parts of an audio recording with different speakers.

Crawl4AI is a web crawler and scraper for developers feeding websites into AI agents, RAG systems and data pipelines. It can extract useful page content without requiring an LLM.

Atlas Note combines a self-hosted note library with AI search and answers that cite your notes. It's for people keeping meeting records, project notes or personal reference material who want to find related information without remembering exact wording. The browser interface runs on your own Docker-hosted server, and the project is open source under the MIT license.

Qwen3-TTS is a family of local text-to-speech models for developers building speech applications or creating audio with custom voices.

LLM is a command-line tool and Python library for developers who want to use language models in terminal workflows or applications. It supports models running on your machine alongside remote providers such as OpenAI, Anthropic and Google.

Pezzo helps developers and teams manage prompts and investigate problems in LLM applications. It brings prompt editing and monitoring into one place for projects where several people contribute to AI behavior.

exo is a local LLM runner for people who want to run models too large for a single machine's memory. It joins devices into a cluster and runs inference on your own hardware.

Hillnote is a writing and planning workspace for people who want local files and AI help inside their editor. It keeps your work as plain Markdown on disk, readable by other editors and accessible to AI agents.

chaiNNer is a desktop editor for people who want AI upscaling and repeatable image processing without writing scripts. Its visual workflows combine model processing with ordinary edits, so you can reuse the same chain across a collection of images.

SeekerClaw runs a personal AI agent on Android phones for people who want recurring tasks, device control and Solana wallet actions through Telegram or Discord. The agent stays active in the background and uses Claude, OpenAI, OpenRouter or an OpenAI-compatible gateway for its AI engine.

RedAmon is an AI penetration testing framework for security teams testing systems they're authorized to assess. It connects attack-surface discovery, exploit testing and code fixes in one self-hosted workspace.

H2O LLM Studio helps teams adapt language models to their own datasets through a browser interface, without writing training code. It's aimed at organizations building models for specific tasks.

AlexClaw is a personal AI agent for monitoring information sources and automating recurring tasks on your own infrastructure. It has one operator and no multi-user access control.

Hermes HUD is a browser dashboard for people who already run the Hermes AI agent and want to inspect its activity and persistent memory. It requires a running agent and reads its local data.

macmon is a local system monitor for people checking how demanding workloads, including local AI, use an Apple Silicon Mac. Its terminal interface shows live hardware readings and a process list without requiring administrator privileges.

Writeopia is a text editor for writers, developers and researchers who want AI assistance with drafts and notes while keeping their work on their own computer.

ChatGPT Subtitle Translator translates SRT subtitles for people who need translated text to stay matched to the original entries. It supports local Ollama models and OpenAI-compatible providers, so you can choose where translation runs.

MartinLoop runs around coding agents to keep software jobs within agreed boundaries and check their results. It's for developers and engineering teams who want to delegate longer tasks while retaining limits, recovery information and a record of what happened.

Msty is a family of AI products for individuals, teams and organizations working with models and their own knowledge. Msty Studio is its workspace product, with separate products for agents and centralized model access.

Tide Commander is a self-hosted workspace for developers coordinating several AI coding agents across projects. It brings agent conversations and project tools into a browser interface so you can assign work and inspect the results together.

Helicone helps developers inspect and debug LLM applications, including agents, chatbots, and document processing pipelines. It combines request monitoring with a gateway for routing calls across AI providers.

ColGREP helps developers and coding agents find relevant code even when they don't know the exact words to search for. It runs locally, while NextPlaid, the search engine behind it, can also serve other retrieval applications on a self-hosted server.

Smart Second Brain is an Obsidian plugin for people who want to find and work with information across their notes. It connects search and a topic graph with an AI assistant that can use your vault as context.

DataFlow is a Python system for researchers and teams preparing data for LLM training or RAG. It turns noisy PDFs, plain text, and question-answer datasets into data suited to a specific domain or training task.

Claude Squad is a terminal app for developers who want several AI coding agents working on separate tasks at once. It keeps their sessions in one window and gives each task its own Git workspace and branch.

Sentence Transformers is a Python library for developers building search and document retrieval on their own hardware. It helps match content by meaning and rank results against a query.

APIPark is an AI gateway and API developer portal for teams managing model services and business APIs. It gives applications a common request format and lets teams share APIs with controlled access.

Siftly helps people with large Twitter/X bookmark collections find saved posts and organize them by topic. It runs on your own machine, with AI processing handled by the endpoint you choose.

Open Assistant is a self-hosted personal AI assistant for people who want it to act on their email, calendar, files, and notes. It runs in a single Docker container with a browser interface. A coordinator assigns requests to specialist agents, so a conversation can lead to finding an invoice, scheduling a meeting, or researching a topic.

Qwen2.5-VL is a vision-language model for developers building visual assistants, document processing applications and screen-based agents. It answers questions about images and video and can return structured data for software to use.

DeepTeam is a Python framework that runs on your machine to test chatbots, AI agents and retrieval-augmented generation applications for security failures. It's for developers and security teams who want adversarial tests they can repeat as an application changes. Its model-powered attacks and scoring use the selected provider; calls to OpenAI or other cloud services send data off your machine.

Fluid is a local AI assistant for Mac users who want to ask questions without sending their chats to a hosted model. It runs Meta Llama 3 on your Mac and supports offline conversations.

Prime Agent is a local terminal coding and research agent for work that continues across sessions. It runs commands and edits files in your project directory, while a persistent Python environment keeps working state available. Its hosted subscription and API-key routes send model requests to the selected provider; local execution doesn't imply offline inference.

Pi Extensible Workflows is an extension for developers who want repeatable processes involving several AI agents. It coordinates resumable workflows inside the Pi host environment and lets you inspect work while it runs.

Dagu turns existing scripts and runbooks into scheduled workflows for operations, data pipelines, and AI automation. You define dependencies and actions in YAML, then inspect runs and retry failures from its built-in Web UI.

Leawo PhotoIns is a proprietary desktop AI photo editor for Windows and macOS that combines photo enhancement, background removal and image enlargement. It's aimed at people who need to correct individual photos or process a batch without editing every image by hand. Each of its main functions supports automatic processing and manual adjustments.

OLMo is a language model family from Ai2 for researchers and developers who want to run models on their own hardware or study how they're trained. It provides model weights, datasets, code and reports for examining and adapting the models.

AI Automation Suggester helps Home Assistant users find automation ideas based on their home's devices, rooms and existing automations. It produces YAML suggestions for review rather than installing automations itself.

OWL is a Python framework built on CAMEL-AI for developers who want multiple AI agents to work together on tasks. It combines research, file analysis, and actions in a browser or terminal within one task workflow.

Icebreaker is a local AI chat app for people who want to converse with language models running on their own hardware. It uses llama.cpp, with Hugging Face also part of its model stack.