Local AI Apps and Tools for Linux

dstack is a self-hosted AI compute orchestration tool for teams running development, training and inference across cloud providers and their own servers. It gives those workloads a shared interface across Kubernetes, VMs and bare-metal clusters.

webctl gives developers and AI agents command-line control of a browser for website tasks. It uses Chromium through Playwright and connects with coding assistants through skills and prompts.

Jan is a desktop AI chat app for people who want to run models on their own computer while retaining the option to use cloud providers. Local model use works offline; choosing a hosted model sends requests to that provider.

GuideLLM benchmarks LLM deployments so engineering and ML teams can assess capacity and response times under expected traffic. It can test self-hosted servers through OpenAI-compatible or vLLM-native interfaces.

NullClaw runs AI agents on your own hardware or server for coding work and automated background tasks. It's aimed at developers who want an assistant that can carry out multi-step jobs with controls over its access and actions.

Fabric organizes reusable AI prompts by task for people who want repeatable ways to analyze content, write, or work with code. Its community-contributed prompts, called Patterns, provide a starting point without requiring you to write each prompt yourself.

Opcode gives developers a visual interface for working with Claude Code across projects. It brings coding sessions, reusable agents, and usage records into one desktop app.

BrowserSkill connects AI agents to your signed-in Chrome or Microsoft Edge profile for web tasks and website debugging. It's for people who want agents to work with existing accounts and developers investigating browser bugs.

Super Agent Party is an AI companion platform for people who want a desktop character that can also carry out tasks. It combines character conversations with agents that operate applications and interact through messaging or live streams.

ChuanhuChatGPT is a self-hosted web interface for people who want to chat with local LLMs and cloud models in one application. It also supports document questions and automated agent tasks.

HunyuanDiT is a local text-to-image model for people generating images from Chinese or English prompts. It handles detailed descriptions and Chinese cultural references, including poetry, idioms, food and architecture.

Tolaria is a desktop knowledge base for personal notes, company documentation, and assistant memory. It keeps your material in ordinary Markdown files that other editors and tools can read.

python-audio-separator splits recordings into separate vocal and instrumental tracks on your own hardware. It's a Python package for karaoke creators and developers who want to process audio in scripts or applications.

CubeSandbox is a self-hosted sandbox service for teams that need AI agents to execute code on their own infrastructure. Each sandbox has its own operating system kernel inside a hardware-isolated MicroVM.

VideoLingo is a video translation app for creators and educators producing bilingual subtitles or dubbed videos. Its self-hosted browser interface brings transcription, translation and subtitle preparation into one workflow, though the selected providers determine which processing stays local.

PenguinHarness builds runnable AI agent applications from plain-language requirements on your computer or server. It's for developers who want agents to handle app creation, evaluation, tuning and deployment.

LiteRT is Google's framework for developers adding machine learning and generative AI to apps that run on users' devices. It succeeds TensorFlow Lite and supports local inference without a server round trip.

HunyuanCustom generates videos of specific people or objects for creators and researchers who need subjects to stay recognizable across frames. It builds on HunyuanVideo and supports generation on your own hardware.

Agent Console helps developers and teams monitor Claude Code and Codex sessions through a local dashboard. It reads the agents' transcripts on your machines so you can compare usage and spot sessions that need attention.

MOSS is a conversational language model from Fudan University for developers and researchers who want to run and adapt a local LLM. It includes model weights, dialogue datasets and fine-tuning code.

MCP Toolbox for Databases connects coding assistants and AI agents to databases. It's for developers who want assistants to inspect data during development or use defined database actions in applications.

ai-memory keeps project context for developers who switch coding assistants or machines. It preserves unfinished work, failed approaches and open questions so the next session can pick up the task.

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

AgentENV runs isolated environments for AI agents across your own servers. It's for teams building parallel agent workflows or reinforcement learning systems that need many separate sandboxes.

exo is a local LLM runner for people who want to run models too large for a single machine's memory. It joins devices into a cluster and runs inference on your own hardware.

chaiNNer is a desktop editor for people who want AI upscaling and repeatable image processing without writing scripts. Its visual workflows combine model processing with ordinary edits, so you can reuse the same chain across a collection of images.

RedAmon is an AI penetration testing framework for security teams testing systems they're authorized to assess. It connects attack-surface discovery, exploit testing and code fixes in one self-hosted workspace.

H2O LLM Studio helps teams adapt language models to their own datasets through a browser interface, without writing training code. It's aimed at organizations building models for specific tasks.

Hermes HUD is a browser dashboard for people who already run the Hermes AI agent and want to inspect its activity and persistent memory. It requires a running agent and reads its local data.

Writeopia is a text editor for writers, developers and researchers who want AI assistance with drafts and notes while keeping their work on their own computer.

ColGREP helps developers and coding agents find relevant code even when they don't know the exact words to search for. It runs locally, while NextPlaid, the search engine behind it, can also serve other retrieval applications on a self-hosted server.

Siftly helps people with large Twitter/X bookmark collections find saved posts and organize them by topic. It runs on your own machine, with AI processing handled by the endpoint you choose.

Qwen2.5-VL is a vision-language model for developers building visual assistants, document processing applications and screen-based agents. It answers questions about images and video and can return structured data for software to use.

Dagu turns existing scripts and runbooks into scheduled workflows for operations, data pipelines, and AI automation. You define dependencies and actions in YAML, then inspect runs and retry failures from its built-in Web UI.