Local & Self-Hosted AI Tools

Docker Model Runner lets developers run AI models on their own computers or servers and connect them to applications. It combines local inference with model distribution through container registries.

Code Graph RAG helps developers understand and change unfamiliar repositories, including monorepos that mix languages. It maps code relationships into a knowledge graph so questions and edits can use context across files.

My Neuro is a local AI desktop companion for people who want to create a character with their own choice of appearance, voice and personality. It supports spoken and typed conversations, with character expressions and movements that respond to the dialogue.

Presidio is a self-hosted framework for developers and organizations that need to remove personally identifiable information (PII) from data. It detects sensitive details such as names, credit card numbers and phone numbers, then applies configurable de-identification.

Hivemind is a Python library for researchers and teams that want to train a shared neural network across computers owned by universities, companies or volunteers. It uses PyTorch and connects participants over the internet, so contributors can pool their machines for a training job without a central master node.

Vald is a distributed vector search engine for developers building similarity search into applications. It runs on a self-hosted Kubernetes cluster and finds approximate nearest neighbors in dense vectors using NGT. It's open source under the Apache 2.0 license, with an architecture designed to spread large vector collections across multiple machines.

QualityScaler is a local AI upscaler for people who want to enlarge photographs and videos and reduce noise through a Windows desktop app. It processes media on your PC without an internet connection.

DiCE is an open-source Python library that finds changes to an input that would make a machine learning model produce a different result. It's for model developers and researchers who need to explain individual predictions or examine a model's dependence on particular features. It generates several alternatives, so people can compare different routes to the desired prediction.

Docling turns documents into structured content for developers building search, retrieval and AI applications. It handles page structure and scanned text so applications can work with more than a file's plain text.

OlliteRT lets you use an Android phone as a private AI server for apps on your local network. It's for people who want to run models locally for chat clients or home automation without a cloud inference service.

Topaz Gigapixel enlarges images for print, close crops and photo restoration. It's for photographers, artists and designers who need more detail from small originals or older pictures.

Code Buddy is a terminal AI coding agent for developers who want it to read a repository, make changes and run commands on their machine. It supports local models through Ollama as well as cloud providers.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

VAR is an image generation research toolkit for researchers and developers studying autoregressive models as an alternative to diffusion. It generates images through next-scale prediction, building finer detail across successive image scales.

SMAC3 is a Python tool for researchers and developers tuning machine learning models or other algorithms on their own hardware. It combines Bayesian optimization with a racing mechanism that decides which configurations deserve further evaluation. It runs locally on Linux, Windows and macOS, and supports parallel evaluation on clusters through Dask.

PaddleSpeech is a speech and audio toolkit for developers and researchers building applications on their own machines or servers. Built on PaddlePaddle, it supports pretrained models alongside training and evaluation workflows.

FaceFusion is an AI face editing tool for people creating altered faces and lip-synced media on their own computer. It combines face manipulation with tools for improving faces and frames.

Linkwarden is a bookmark manager for people and teams building a lasting collection of web references. It saves copies of pages so you can revisit their content after the original links disappear.

HD-BET uses neural networks to separate brain tissue from surrounding structures in MRI scans. It runs locally and is aimed at researchers and medical imaging teams who need automated brain masks, including for scans affected by tumors, lesions or surgical resection cavities.

gpustat is a local terminal monitor for people running AI workloads or sharing accelerator hardware. It helps you check device activity and identify the jobs using memory without opening a separate dashboard.

SmolLM3 is a compact language model from Hugging Face for developers building local AI applications and researchers studying model training. It has 3B parameters and comes in base and instruction-tuned variants.

CamoFox Browser is a self-hosted browser server for developers whose AI agents need to interact with sites that detect browser automation. It builds on Camoufox, a Firefox fork with browser fingerprint spoofing, to reduce detection by systems such as Cloudflare and Google's bot checks.

RuoYi AI is a self-hosted AI assistant platform for teams building assistants that answer questions about their documents or perform tasks with external tools. It has separate user and admin interfaces.

Jido is an Elixir framework for developers who want to run cooperating agents inside their own application or self-hosted server. Its BEAM runtime handles agent state, tool execution and coordination. AI is optional: the core supplies the runtime, while jido_ai adds model integration separately.

Wav2Lip changes a face's mouth movements in an existing video to match supplied speech. Its research version is for noncommercial projects, including experiments with lip-sync generation and model training.

IP-Adapter adds reference-image prompting to Stable Diffusion for artists and developers who want to guide generation with an image rather than describe every detail in words. It works with an existing text-to-image model and can combine image references with text prompts.

Flair is a free Python library for developers and researchers who need to extract information from text or train their own natural language processing models. It combines pretrained text analysis models with tools for building word and document embeddings, all within a framework built directly on PyTorch.

Seamless Communication is Meta's family of AI models for developers and researchers building multilingual speech applications. It covers translation and transcription, with dedicated models for conversations and expressive speech.

MCPJam helps MCP server developers check how their tools and apps behave across AI clients before deployment. It combines hands-on debugging with repeatable tests for differences between ChatGPT, Claude, Cursor, and Copilot.

Sonar serves language and multimodal models for developers and teams running AI applications on their own hardware. It builds on vLLM and works with Hugging Face-compatible models.

ToolJet is an internal-app builder for developers and operations teams creating dashboards, admin panels and business tools around existing data. It can run on your own infrastructure with Docker or Kubernetes, or through ToolJet Cloud. The community foundation uses AGPL-3.0; Enterprise features use separate commercial terms.

DevOpsGPT is a self-hosted AI development application for teams turning written requirements into code and deployment work. The browser interface and generated-code workspace run on your machine or server, while GPT requests use the OpenAI API with a token and incur provider charges.

HitPaw VikPea is a paid AI video enhancer for Windows and macOS, aimed at people restoring family recordings, improving compressed clips, or preparing footage for larger screens. It combines upscaling to 4K or 8K with tools for blur, noise, and compression artifacts. It also enhances AI-generated videos from Kling, Sora, Veo, and Seedance.

sandboxd is an AI app builder for teams hosting coding agents, playgrounds or app previews on their own server. It turns prompts into running apps, each with an isolated workspace and its own preview URL.

cook coordinates coding agents for developers who want repeated reviews or competing implementations of a task. It supports Claude Code, Codex and OpenCode, and lets you combine sequential work with parallel attempts.

Taskuary is a personal AI work manager for people whose requests arrive across email, chat and ticket systems. It gathers those requests into tasks and lets AI agents prepare the work for your review.

OpenHarness SDK is a TypeScript toolkit for developers building coding assistants and other AI agents into their own applications. It gives the application control over conversation history, tool permissions and task delegation.

OGX, formerly Llama Stack, is an AI application server for developers building chat apps, document search and AI agents. It brings model access and the services those applications need into a server you can host yourself.

Everywhere is a desktop AI assistant for people who want help with the app they're working in without copying its contents into a separate chat. It reads on-screen context to answer questions and carry out tasks across apps.

TensorRT-LLM is an inference library for developers serving LLMs on their own NVIDIA GPUs. It supports application-level inference and server deployments, with performance optimizations for workloads spread across one or several machines.

Dopamine is a reinforcement learning framework for researchers who want to modify agents and test algorithm ideas. Its compact codebase focuses on a limited set of established algorithms and supports experiments on your own hardware.

AX is a self-hosted AI agent orchestrator for teams running autonomous tasks on Kubernetes. It manages agents that retain state and need access to models, repositories and tools while they work.

RD Agent is a self-hosted AI research agent for data scientists, researchers and quantitative developers. It runs experiments on a Linux machine or server, while chat and embedding requests use providers through LiteLLM, including OpenAI and Azure OpenAI. Those remote configurations require API credentials and internet access; hosting the agent yourself doesn't move their inference onto your hardware.

Flexible GraphRAG is a self-hosted platform for teams building document search and AI chat that use both text and relationships between entities. It extracts knowledge graphs from documents and combines graph retrieval with vector similarity and full-text search. You can run it standalone or in Docker. It's open source under Apache 2.0.

PhotoMaker generates personalized portraits and artwork from reference images and text prompts. It's for people creating photos or avatars that retain a person's recognizable features across different settings and styles.

Gondolin is a local sandbox for developers whose AI agents execute generated code. It separates that code from the host while letting developers control access to files, network destinations and API credentials.