Local AI Apps and Tools for Linux

DeepEP handles communication between GPUs for teams training or serving mixture-of-experts (MoE) models on their own servers. It moves tokens to the GPUs that hold the selected experts and combines their outputs.

Front Porch AI is a desktop app for character chat and roleplay with local LLMs. It's for people who want to keep their conversations on their own machine while building stories with characters that retain memories and changing emotional states.

EchoMimic turns a portrait and an audio recording into a talking-head video on your own hardware. It's intended for academic research into speech animation and controlled facial movement.

Vibe-Research is a local financial research workbench for individual investors, with a Chinese-language browser interface and backend on your computer. It saves documents, research records and task state locally, while subscription services or model APIs supply AI reasoning. Relevant document passages go to the selected model, so local storage doesn't make the workflow offline.

Murmur is a desktop dictation app for people who want to speak into the apps they already use. It turns speech into text and inserts it at the cursor.

OpenLore helps developers keep AI coding agents grounded in large or unfamiliar repositories. It maps code relationships and retains architectural decisions so agents can find relevant context and check proposed changes.

Obelisk makes past coding agent sessions searchable for developers who need to recover decisions or revisit earlier work. A desktop browser and an agent skill give people and coding assistants access to the same local history.

NVIDIA cuML is a Python machine learning library for data scientists whose scikit-learn, UMAP or HDBSCAN workloads take too long on a CPU. It runs on NVIDIA GPUs in Linux or WSL 2, on a workstation or across a cluster. The project is open source under Apache 2.0.

Omnigent coordinates AI agents for developers and teams who want to combine coding assistants, control their access, and supervise work in shared sessions. It runs locally or on a self-hosted server, with remote cloud sandboxes as another option.

OpenAdapt automates repeated work in application interfaces that APIs can't reach. Teams and AI agent builders can turn a demonstrated task into an inspectable program, approve it for use, and check that each run produces the agreed result.

Vinaya Journal is a desktop journal for people who want AI-assisted reflection while keeping their writing on their own machine. It's built for daily journaling, with AI that uses past entries as context for conversation.

Buzz turns speech into transcripts and subtitles on your computer. It's for people working with recordings or providing live captions who want offline transcription and translation into English.

DeepLabCut is an open-source toolbox for researchers who want to track animal movement and behavior on their own computers without attaching physical markers. It estimates the positions of visible features you choose, with support for animals, humans and objects rather than a fixed set of species or body parts.

BankMCP connects an AI assistant to your own European bank accounts so you can ask about spending, balances and incoming payments. It's a self-hosted connector for one user, with read-only access: it can't make payments.

ONNX Runtime is an AI inference and training engine for developers adding models to apps and services. It supports deployment on a user's device or a server, including applications that need the same model format across platforms.

Palace gives AI coding agents persistent memory of project decisions, conventions and fixes. Developers can carry that context between sessions in Cursor, Claude Code, Codex and Claude Desktop.

Halo is a desktop AI workstation for people who want agents to write code, manage files and handle recurring work through a visual interface. You can switch between Claude Code and Codex within the same app.

TRELLIS is a local AI model for artists and researchers generating 3D assets from images or text. It supports several 3D representations and can edit generated assets as well as create them.

Augmentoolkit turns documents into datasets for training an LLM on a particular subject. It's for people building custom models around material such as research papers or fictional lore.

Translate Books With LLMs translates books, documents and subtitles using a local or cloud model. It's for readers and translators working with long texts who need formatting and terminology to carry through the translation.

SwarmLLM is a ChatGPT alternative for people who want to run AI models on their own hardware. It can use a single computer or combine several machines to handle a model that won't fit on one.

Tolmach translates complete books for readers and translators who need consistent terminology across chapters. It uses local LLMs through Ollama, with optional Ollama Cloud models.

SiYuan is a knowledge workspace for people who want to connect notes, reference material and individual passages. Its block-based editor lets you link directly to a piece of text rather than an entire document.

Lotti is a private logbook for people who want to keep their plans and a record of what actually happened together. It connects daily planning with personal notes and work history while keeping the underlying record on your devices.

OpenChamber is a workspace for developers who want to run AI coding agents on their own computer or server and review the results. It uses OpenCode to run agents and keeps projects and sessions accessible across devices.

Claude Task Master helps developers turn product requirements into tasks they can work through with a coding assistant. It keeps task planning and progress tracking inside the editor or terminal where development happens.

PicoClaw is a self-hosted personal AI assistant that can use local models through Ollama or vLLM. It's aimed at people who want an agent on their own hardware, including small Linux boards and Android phones. Hosted providers are optional, but choosing OpenAI, Anthropic, Google Gemini or DeepSeek sends model requests to those services and requires internet access and API keys.

Coding Tools MCP gives AI chat apps and coding agents access to a repository on your machine. It's for developers who want to use an existing MCP client to inspect code, make edits and check a running project.

Lap is a desktop photo manager for family albums, photographers, and large personal libraries. It works with photos in your existing folders and uses local AI to help you find images without uploading them to a cloud photo service.

Kelivo is an LLM chat client for people who want local and cloud models in one app while keeping conversation history on their device. It connects to Ollama, self-hosted OpenAI-compatible services and providers including OpenAI, Gemini, Claude, DeepSeek and OpenRouter.

LongMemory gives LLM applications and AI agents persistent memory across sessions. Developers can use it to retain project decisions and conversation context while distinguishing current facts from information that was true earlier.

WhisperLive turns speech into text as audio arrives, using OpenAI's Whisper models. It's for developers and teams who want to run transcription on their own machine or server and connect it to live audio or recorded files.

TokensBurned tracks AI coding activity for developers who want usage statistics on their GitHub profile. Its client processes records locally, but the profile cards depend on a hosted service that receives aggregate data.

BitNet is Microsoft's local LLM inference framework for developers and researchers working with compatible 1-bit models. Its bitnet.cpp runtime focuses on faster inference and lower energy use on your own hardware.