Local AI Apps and Tools for Linux

X-AnyLabeling is a desktop annotation workspace for researchers and teams preparing text, image, video, point cloud, and multimodal training datasets. Models generate initial labels, and reviewers correct them in the same workspace before exporting the data. It runs on Windows, Linux, and macOS under the GPL-3.0 open-source license.

ncnn is a C++ inference framework for developers adding on-device AI to mobile, desktop and embedded applications. It focuses on a small memory footprint and doesn't require third-party runtime dependencies.

Facet combines photo culling with a self-hosted gallery for photographers choosing keepers from a shoot or organizing a personal library. Its AI analysis runs on your own machine without cloud services, accounts or API keys.

llama-swap is a local AI proxy for people who want several models available to their apps without keeping them all loaded. It starts the server a request needs and replaces the active server when another model is requested.

Chidori is an AI agent framework for developers building long-running workflows that need crash recovery or human approval. Agents use ordinary async TypeScript, with saved runs that developers can revisit for debugging and testing.

Kwipu helps people query a document folder or Obsidian vault and trace answers back to their notes. It connects information across documents so you can investigate project decisions, people and their roles, or relationships between ideas.

5ire is a desktop AI assistant for people who want to chat with models, ask questions about their documents and use external tools in the same app. It connects to local LLMs through Ollama and to cloud providers including OpenAI, Anthropic, Google and DeepSeek.

Ruflo is an AI agent framework for developers who want Claude Code and Codex to work as coordinated teams. It adds specialist roles and shared context for projects that involve coding, testing, architecture and documentation.

Pinokio is a local AI app launcher for people who want to try community projects without handling each app's terminal commands themselves. It brings app discovery and management into a desktop interface.

Docker Model Runner lets developers run AI models on their own computers or servers and connect them to applications. It combines local inference with model distribution through container registries.

Hivemind is a Python library for researchers and teams that want to train a shared neural network across computers owned by universities, companies or volunteers. It uses PyTorch and connects participants over the internet, so contributors can pool their machines for a training job without a central master node.

Docling turns documents into structured content for developers building search, retrieval and AI applications. It handles page structure and scanned text so applications can work with more than a file's plain text.

Code Buddy is a terminal AI coding agent for developers who want it to read a repository, make changes and run commands on their machine. It supports local models through Ollama as well as cloud providers.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

SMAC3 is a Python tool for researchers and developers tuning machine learning models or other algorithms on their own hardware. It combines Bayesian optimization with a racing mechanism that decides which configurations deserve further evaluation. It runs locally on Linux, Windows and macOS, and supports parallel evaluation on clusters through Dask.

PaddleSpeech is a speech and audio toolkit for developers and researchers building applications on their own machines or servers. Built on PaddlePaddle, it supports pretrained models alongside training and evaluation workflows.

HD-BET uses neural networks to separate brain tissue from surrounding structures in MRI scans. It runs locally and is aimed at researchers and medical imaging teams who need automated brain masks, including for scans affected by tumors, lesions or surgical resection cavities.

CamoFox Browser is a self-hosted browser server for developers whose AI agents need to interact with sites that detect browser automation. It builds on Camoufox, a Firefox fork with browser fingerprint spoofing, to reduce detection by systems such as Cloudflare and Google's bot checks.

RuoYi AI is a self-hosted AI assistant platform for teams building assistants that answer questions about their documents or perform tasks with external tools. It has separate user and admin interfaces.

Wav2Lip changes a face's mouth movements in an existing video to match supplied speech. Its research version is for noncommercial projects, including experiments with lip-sync generation and model training.

Seamless Communication is Meta's family of AI models for developers and researchers building multilingual speech applications. It covers translation and transcription, with dedicated models for conversations and expressive speech.

Sonar serves language and multimodal models for developers and teams running AI applications on their own hardware. It builds on vLLM and works with Hugging Face-compatible models.

DevOpsGPT is a self-hosted AI development application for teams turning written requirements into code and deployment work. The browser interface and generated-code workspace run on your machine or server, while GPT requests use the OpenAI API with a token and incur provider charges.

sandboxd is an AI app builder for teams hosting coding agents, playgrounds or app previews on their own server. It turns prompts into running apps, each with an isolated workspace and its own preview URL.

Taskuary is a personal AI work manager for people whose requests arrive across email, chat and ticket systems. It gathers those requests into tasks and lets AI agents prepare the work for your review.

RD Agent is a self-hosted AI research agent for data scientists, researchers and quantitative developers. It runs experiments on a Linux machine or server, while chat and embedding requests use providers through LiteLLM, including OpenAI and Azure OpenAI. Those remote configurations require API credentials and internet access; hosting the agent yourself doesn't move their inference onto your hardware.

Gondolin is a local sandbox for developers whose AI agents execute generated code. It separates that code from the host while letting developers control access to files, network destinations and API credentials.

GenericAgent runs tasks on your computer using cloud models to decide what to do. It's for people who want an AI agent to work across websites, files and desktop apps, then save successful workflows for reuse. Model calls require API keys and an internet connection, with requests going to the selected provider. It supports Claude, Gemini, Kimi and MiniMax.

Kokoro-FastAPI generates speech on your own machine or server using Kokoro-82M. It's for developers adding narration to reading apps, audiobooks or voice assistants through an OpenAI-compatible speech API.

Voicebox combines speech creation and dictation for people producing audio or working with AI agents. It's a free, open-source alternative to ElevenLabs and WisprFlow that processes voice data on your own machine.

CDAF saves reusable text descriptions alongside videos so AI agents don't have to analyze the same footage for every task. It's for developers building video agents and editors that repeatedly search or ask questions about a clip library.

digiKam is a free, open-source photo manager and image editor for photographers managing large collections of photos and videos. It combines library organization with editing and tools for finding images by their content or metadata.

Anarlog, formerly Hyprnote, is a desktop AI meeting notetaker for people who want to keep sensitive conversations on their own hardware. It's an open-source Granola alternative that combines personal notes with meeting transcripts.

Abogen turns books, documents and subtitle files into narrated audio for readers making audiobooks and creators producing voiceovers. It can generate matching captions or follow timestamps for timed narration.