Local & Self-Hosted AI Tools

Shuru gives AI agents a disposable Linux virtual machine on your Mac. It's for developers who want coding assistants to execute code, install packages and use tools in an environment isolated from the host.

UGTLive translates text on your Windows screen for games, manga reading and language study. It places translations over the app you're viewing and requires an NVIDIA RTX 20, 30, 40 or 50 series GPU with at least 8 GB VRAM.

iZotope RX is audio restoration and editing software for music producers, podcast creators and film or TV sound editors. It helps repair damaged recordings and adjust parts of audio that have already been mixed together.

TPOT is a Python AutoML library for data scientists and researchers who want to automate machine learning pipeline selection on their own hardware. It uses genetic programming to search candidate pipelines, reducing the manual work of comparing models and tuning their parameters. It's free and open source under LGPL-3.0.

total-agent-memory gives AI coding agents persistent memory of decisions, fixes and project conventions across sessions and repositories. It's for developers who don't want to keep explaining earlier work to Claude Code, Codex CLI, Cursor or another MCP client.

MediaPipe is a toolkit for developers adding on-device AI to applications. It provides pretrained models and task APIs for applications that need to process images, video, text or audio on the user's device.

AIClient2API is a self-hosted AI API proxy for developers connecting chat apps and coding assistants to multiple model providers. It exposes services such as Antigravity, Codex, Grok, and Kiro through interfaces those apps already support.

Fish Diffusion is a Python framework for developers and researchers training diffusion models for text-to-speech, singing voice synthesis and singing voice conversion. It works with your own datasets and provides code you can adapt for different voice generation tasks.

Instructor is a library for developers who need to turn text into structured data using an LLM. Its focus is extraction, with typed outputs that applications can use and validation rules that check the model's responses.

AudioLDM 2 is a local AI audio generator for sound designers and researchers experimenting with synthetic sound. It uses pretrained models to produce audio from text and provides a Gradio browser interface alongside command-line access.

Wan2GP generates media on your own computer for creators who want to work with several AI models in one browser interface. It builds on Wan-Video/Wan2.1 and focuses on making generation accessible on GPUs with limited memory.

Optuna is a Python framework for machine learning developers and researchers who want to automate the search for model settings. Its search spaces can change with the choices made during a trial, so it can compare model architectures or classifiers as well as tune individual parameters. It's open source under the MIT license and can run on your own hardware as part of a Python workload.

Wingman-AI is a self-hosted AI agent platform for developers and teams handling coding, research, operations or support tasks that need ongoing context. It coordinates agents with distinct roles and retains their sessions across clients.

nanochat is a toolkit for researchers and developers who want to train an LLM and inspect the pipeline themselves. Its small Python codebase covers the stages between preparing a tokenizer and chatting with the resulting model.

OpenBitFun is a desktop AI agent workspace for coding and other tasks that use files and shell commands on your machine or a selected SSH host. It runs on Windows, macOS and Linux. Model requests go to the configured provider; built-in cloud connections send them to external services, and custom providers are also supported.

TranscriptionSuite is a speech-to-text app for people recording lectures, transcribing conversations or dictating documents on their own hardware. Transcription works offline after the app and model downloads, keeping audio and transcripts local.

OpenCompass is an LLM evaluation framework for researchers and developers comparing models for their applications. It lets you assess models on your own hardware alongside cloud APIs in the same experiment.

LobeHub is an AI agent workspace for individuals and teams assigning ongoing work to multiple assistants. It keeps agents, their tasks and shared material together, with hosted and self-hosted options.

PapersGPT is an AI research assistant inside Zotero for researchers working through a paper library. It helps answer questions across saved research and turn findings into notes with citations back to the papers.

GFPGAN is an AI face restoration tool for repairing low-quality photos and adding restoration to image workflows. It reconstructs facial detail using a pretrained generative model, so results can alter a person's likeness.

SwarmUI is a self-hosted AI image generation interface for people who want both straightforward generation controls and access to detailed ComfyUI workflows. You can use it with models running on your own hardware.

AutoTS is an open-source Python package for people who need forecasts across many time series without choosing a model and preprocessing method for each one. It runs in your own Python environment and uses automated search to compare forecasting approaches for your data. The license is MIT.

Shinkai lets people build AI agents to automate tasks without writing code. Its desktop app can run agents entirely offline with local models, including workflows that handle sensitive data.

PhotoMaker generates personalized portraits and artwork from reference images and text prompts. It's for people creating photos or avatars that retain a person's recognizable features across different settings and styles.

DaVinci Resolve Studio is a paid desktop video editor for macOS, Windows and Linux that combines editing, color grading, visual effects and audio post production. It's for editors, colorists and studios who want AI tools within the same application they use to finish a film or video.

gen.nvim brings LLM text generation into Neovim for developers and writers who want AI help within their editor. It can work with a selected passage or the current buffer, so you can ask about or revise the content you're editing.

TaxHacker is a self-hosted AI accounting app for freelancers, indie hackers, and small businesses that need to turn receipts and invoices into searchable transactions. The project is in early development. Its open source edition runs on your own infrastructure or home server through Docker and uses the MIT license.

Tutor-GPT is a self-hosted browser application for learners who want an AI tutor that adjusts to their learning needs. You can host its Next.js server yourself, including through Docker. Model responses come from a separate inference provider, with OpenRouter integration sending requests to an external service.

GPyTorch is an open-source Python library for researchers and developers building Gaussian process models in PyTorch. It runs model inference on your own hardware and can use GPUs to accelerate computation. Its focus is on making Gaussian processes practical at larger scales while leaving room to define custom models. The library uses the MIT license.

NocoDB is a self-hosted database workspace for teams that want to manage records through a spreadsheet interface. It runs on your own server with Docker and can connect to existing PostgreSQL or MySQL databases. A hosted service is also available.

nerd-dictation turns speech into text for people who want voice input in their Linux applications. It runs recognition locally with VOSK and works offline, with command-line controls for dictation.

llmcord is a self-hosted Discord bot for people who want to share AI conversations with friends or a community. It connects Discord chats to local models or remote providers. Conversation history stays in Discord, even when the model runs on your own hardware.

Bisheng is a self-hosted AI application platform for teams working with business documents and processes. It supports tasks such as document review, support ticket assistance and fixed-layout report generation, including workflows that need human judgment during execution.

Qwen-Agent is a Python framework for developers building assistants that use Qwen models to read files and carry out tasks with tools. It provides ready-made agent components and example applications for custom assistants and browser assistance.

VoxCPM is a local text-to-speech system for developers and audio creators who want to generate speech with voices they can design or clone. It supports multilingual narration and control over how a voice delivers the text.

PyTorch Lightning is a Python framework for researchers and developers pretraining or fine-tuning AI models. It handles recurring training infrastructure while leaving the model logic in your PyTorch code.

Musubi Tuner provides training scripts for people who want to adapt image and video generation models with their own datasets. It's aimed at users comfortable with a script-based workflow.

EXAONE is a family of language models from LG AI Research for developers building multilingual AI applications on their own hardware. It combines everyday language tasks with reasoning for harder problems and supports agents that call external tools.

Cognee gives AI agents memory across sessions so they can reuse project context, decisions, and lessons from earlier work. It's for developers building agents and teams whose knowledge sits across documents, code, and conversations.

Claude Code Local lets developers use Claude Code with a model running on their own computer. It suits people who want to keep coding offline or continue working when they hit cloud usage limits.

Unlimited-OCR is an OCR model for developers building document extraction workflows on their own hardware or servers. It handles individual document images and multi-page inputs, including PDFs converted to page images.

Yuxi is a self-hosted AI agent platform for teams that need answers from their documents and agents that can carry out multi-step work. Its browser workspace brings knowledge sources, task progress and generated files into the same conversation.

Spring AI is a Java framework for developers adding AI features to Spring applications. It connects models with application data and APIs for tasks such as answering questions about documents.

KeyBERT is a Python library that extracts keywords and phrases by comparing their meaning with the document they come from. It's for developers and researchers who want to add keyword extraction to text processing projects without training a model from scratch. The library is open source under the MIT license.

Audiblez converts EPUB e-books into spoken audio using Kokoro-82M on your computer. It's for readers who want an audiobook version of a book, with control over the voice and which sections get read aloud.

KittenTTS is a Python text-to-speech library for developers adding local speech generation to apps or producing spoken audio from text. It supports voice cloning without model training and doesn't require a GPU.