Local & Self-Hosted AI Tools

SLEAP helps behavioral researchers measure animal movement in recorded video. It trains models to estimate poses for single animals or groups, with human review during dataset creation and prediction checking.

MLX VLM is a Python package for developers and researchers who want to run multimodal models on their own Mac. It supports local inference and fine-tuning through MLX.

OpenEnsemble is a self-hosted AI assistant platform for people who want shared access on their own server, with a separate workspace for each user. Linux is the main installation target; macOS supports local development with different feature support. You can choose a single assistant or an ensemble of specialist agents using different models. It's open source under AGPL-3.0.

Codex CLI is a terminal coding assistant that works in your local repository on macOS, Windows and Linux. Developers can use it with models running locally through Ollama, including gpt-oss:120b, or connect to OpenAI through a paid ChatGPT account or API key. With OpenAI access, model requests go to the remote service even though file edits and commands run on your computer.

local-transcriber is a free, open-source app for turning audio and video recordings into text on your own computer. It's aimed at people handling private interviews, client calls or long talks who want transcription without uploading recordings to a cloud service. It runs fully offline once the required models are downloaded.

Falcon-H1 is a family of language models from the Technology Innovation Institute for developers building AI applications on their own hardware. Smaller models suit edge devices, while larger variants target server deployments.

Semantica is a Python toolkit for teams building AI systems that need shared context, traceable decisions and policy checks. It connects facts and decisions to their evidence in queryable knowledge graphs.

CliRelay is an AI gateway for teams that want to manage coding assistants through a shared service on their own server. It builds on CLIProxyAPI and brings subscription accounts and provider API keys under central control.

FATE is a self-hosted federated learning framework for enterprises and institutions that want to train models together while protecting data privacy. It supports collaboration across participating organizations and uses homomorphic encryption and multi-party computation (MPC) for secure computation.

Waifu2x-Extension-GUI is a Windows desktop app for enlarging artwork, photos and video with AI. It combines multiple processing engines in one interface for people working with both drawn and photographic media.

n8n is a workflow automation platform for technical teams connecting AI agents to business processes and their own data. Its visual editor lets you inspect individual steps and add code where a workflow needs custom behavior.

MLX Audio is a Python library for developers building speech and audio applications on Apple Silicon Macs. It runs models locally using Apple's MLX framework, with support for generated speech, transcription and audio processing.

Swarm Fleet manages multiple terminal AI agents on your machine for developers coordinating coding, review and ticket work. Each agent has its own terminal, with shared controls for supervising their work.

OpenVINO AI Plugins for GIMP adds image generation and AI editing to GIMP 3 for people who want to work within their existing image editor. Models run on Intel devices through OpenVINO.

Stable Fast 3D generates a textured 3D asset from a single object image. Built on TripoSR, it's aimed at game and VR developers, designers and people making product models for e-commerce.

LocalWriter adds AI writing assistance inside LibreOffice Writer for people who want to draft and revise text within their documents. It works with selected passages and requires a separate language model runner.

Opik is an LLM observability and evaluation platform for teams building AI agents and retrieval-based applications. It helps developers inspect failures and compare behavior across development, testing and production.

Langroid is a Python framework for developers building applications where AI agents divide up a task. Each agent can maintain its own conversation and use documents or tools, then delegate work to other agents.

Chatless is a desktop AI chat client for people who want local models and cloud services in one app. It keeps conversation history on your computer and lets you ask questions about your own documents.

Tandem Browser is a desktop browser for people who want AI agents to carry out web tasks alongside them. You and the agent work in the same logged-in session, so you can watch its actions and step in when needed.

HunyuanWorld generates explorable 3D environments from text prompts or images. It's for game developers, VR creators and researchers who need scene geometry for interactive content or physical simulation.

Agentgateway is an open-source proxy for platform teams connecting applications and agents to models, tools and other agents. It brings routing and access controls together across AI protocols and ordinary service traffic.

VideoCrafter generates video on your own hardware from written prompts or still images. It's aimed at researchers and people exploring video generation for personal use; the toolbox limits use to personal, research and non-commercial purposes.

WhisperBuddy is a native macOS app for people who need transcripts, subtitles, or voice dictation while keeping their recordings on their own computer. It transcribes audio and video files, listens to live input, and translates transcripts offline. Audio and text stay on your Mac.

Inspect AI is a Python framework for researchers and developers evaluating language models and AI agents. It measures coding, reasoning, knowledge, behavior and multimodal understanding, including tasks where agents must take actions to succeed.

Stable Audio Open generates audio from text for artists and researchers experimenting with sound effects, field recordings and music samples. It performs better on effects and environmental sounds than music, and it can't generate realistic vocals.

BrainSoup is a desktop AI agent app for people who want to automate tasks with assistants that have distinct roles and access to their own documents. You direct the agents through conversation and can have them work together on a shared task.

MetaGPT is a Python AI agent framework for developers who want to generate software projects using local models through Ollama or remote model APIs. The framework runs on your machine and writes a project repository locally. Its example configuration uses OpenAI, which sends model requests to that provider and requires API credentials.

Semantic Kernel is an SDK for developers building AI agents and coordinated workflows inside applications. It lets developers choose local model backends or cloud providers for those applications.

Torch-TensorRT compiles PyTorch models with TensorRT to reduce inference latency on NVIDIA hardware. It's for developers running models on their own machines or servers who want faster execution while keeping their PyTorch workflow. The project is open source under the BSD 3-Clause license.

Vane is a self-hosted AI search engine for people who want answers backed by sources they can check. It combines web research with a choice of local or cloud models and saves search history locally.

Voibe is a paid AI dictation and meeting notes app for people handling confidential work, including legal, healthcare and finance professionals. It types spoken text into other apps and captures meetings on a Mac without a bot joining the call. Dictation works on Mac and Windows; meeting capture is Mac-only.

dstack is a self-hosted AI compute orchestration tool for teams running development, training and inference across cloud providers and their own servers. It gives those workloads a shared interface across Kubernetes, VMs and bare-metal clusters.

webctl gives developers and AI agents command-line control of a browser for website tasks. It uses Chromium through Playwright and connects with coding assistants through skills and prompts.

OfflineLLM is an on-device AI chat app for Android users who want to run models locally without sending conversations to a cloud service. It works fully offline and has no network permissions.

Zep Community Edition is a self-hosted memory service for developers building AI agents and conversational assistants. It turns chat history into connected facts so an assistant can recall context across conversations and distinguish current preferences from older ones.

Rasa Open Source is a Python framework for developers building text and voice assistants on their own servers. It provides natural-language understanding, dialogue management and integrations with messaging channels.

Jan is a desktop AI chat app for people who want to run models on their own computer while retaining the option to use cloud providers. Local model use works offline; choosing a hosted model sends requests to that provider.

GuideLLM benchmarks LLM deployments so engineering and ML teams can assess capacity and response times under expected traffic. It can test self-hosted servers through OpenAI-compatible or vLLM-native interfaces.

NullClaw runs AI agents on your own hardware or server for coding work and automated background tasks. It's aimed at developers who want an assistant that can carry out multi-step jobs with controls over its access and actions.

Fabric organizes reusable AI prompts by task for people who want repeatable ways to analyze content, write, or work with code. Its community-contributed prompts, called Patterns, provide a starting point without requiring you to write each prompt yourself.

Dr Doc Search is a self-hosted Python application for asking questions about PDF books and documents. It's for readers who want answers drawn from a particular text and a choice between OpenAI and HuggingFace models. The code is open source under the MIT license.

Willow is a voice assistant for people who want to control home automation through hardware and speech processing they own. It provides an alternative to Amazon Echo or Google Home on Espressif's ESP32-S3-BOX hardware family.

Opcode gives developers a visual interface for working with Claude Code across projects. It brings coding sessions, reusable agents, and usage records into one desktop app.

Nox is a security scanner for developers building LLM applications, RAG systems and agents with tool access. It traces untrusted input into model calls and model output into dangerous operations, including paths across functions and files.

BrowserSkill connects AI agents to your signed-in Chrome or Microsoft Edge profile for web tasks and website debugging. It's for people who want agents to work with existing accounts and developers investigating browser bugs.