Local AI Apps and Tools for Linux

Vellium is a desktop AI app for writers and people who want conversations with fictional characters. It combines multi-character roleplay with writing projects and lets you choose the model provider.

text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.

Kiro Crew is a self-hosted AI development workspace for developers who want agents to keep working between conversations. It runs on your computer or a server you control, but its default kiro-cli backend requires separate Kiro sign-in for model access. The default Kiro connection sends model requests to Kiro's cloud service, powered by Amazon Bedrock.

Research Agent is a free, MIT-licensed, open source AI agent that combines online research with documents on your machine. It's for people investigating technical topics or comparing papers who want cited reports and a choice of local or cloud models. It runs on macOS, Windows and Linux, with a browser dashboard and a command-line interface for automation.

localGPT is a self-hosted document chat app for people who want to ask questions about files and summarise them on their own hardware. Its local processing keeps document content and chat data on the machine running the app.

Gemini CLI is a coding assistant for developers who want to work with an AI agent in their terminal. It can inspect a codebase and act on files and shell commands, with Gemini handling the model responses in Google's cloud.

SilverBullet is a knowledge workspace for personal notes, shared wikis and project documentation. It keeps your writing in plain Markdown files and lets you build connections and collect information across pages.

MioSub is an AI subtitle editor for creators and translators working with video or audio. It handles subtitle generation and translation for local files or downloaded media, including podcasts, radio recordings and audiobooks.

FlashAttention is an attention library for developers training or running transformer models on their own GPUs. It computes exact attention while using less memory than standard PyTorch attention, allowing longer sequences.

xberg, formerly Kreuzberg, is a local document extraction engine for developers building AI search and document processing applications. It turns files into text and structured content that those applications can use.

ExecuTorch is an on-device AI runtime for developers adding PyTorch models to apps and embedded devices. It handles inference on the user's hardware across Android, iOS, macOS, Linux and Windows, as well as embedded systems and microcontrollers.

HomeGallery is a self-hosted photo and video gallery for people browsing a personal media archive without reorganizing their files. It's designed for a single user with some technical knowledge. By default, AI discovery sends preview images to a public analysis API; you can host that API locally instead.

Pallaidium is a Blender add-on for filmmakers and AI artists who want to develop scenes with generated visuals and sound before shooting. It puts generation on the Video Sequence Editor timeline, where you can test dialogue timing and edit scenes alongside music.

Nemotron is NVIDIA's family of AI models for developers building agents that reason, write code and use tools. Teams can evaluate and adapt the models using published weights, training data and training recipes.

Demucs separates mixed music recordings into parts for musicians who want to work with individual instruments or vocals. The author maintains a separate repository, with no active feature development and slow responses expected.

TensorRT is NVIDIA's inference toolkit for developers deploying AI applications on NVIDIA GPUs. Its compilers, runtimes and model optimizations target lower response latency and higher throughput on local machines, self-hosted servers and edge devices.

Paxm gives AI coding assistants persistent memory of project decisions, conventions and past work. It's for developers who want later sessions or another coding agent to recover context they've already explained.

VoxInput is an open-source dictation tool for Linux and macOS that types spoken words into the active application. It's for people who want speech input across their desktop, including applications without their own dictation feature. On Linux, it also works in the system console.

Captain Memo gives developers a shared memory across coding assistants, so project decisions and lessons remain available between sessions and tools. Claude Code, Codex, Gemini CLI, Cursor and other MCP-compatible assistants can access the same corpus.

Instant NGP is neural graphics software for researchers and developers working on 3D reconstruction and rendering. It trains representations of scenes and images on a single GPU, then lets you explore the results interactively.

Lucebox is a local AI workstation for developers and teams who want to run models on their own hardware. Its inference engine is also available separately for supported AMD and NVIDIA machines.

Coqui TTS is a text-to-speech toolkit for developers and speech researchers who want to generate voices locally or train their own models. The idiap fork builds on coqui-ai/TTS.

Locally Uncensored is a desktop AI studio for people who want to chat, create media and work on code on their own PC. It includes mainstream models and variants with fewer refusal restrictions.

CosyVoice is a text-to-speech system for developers building speech applications on their own hardware or self-hosted servers. It can generate speech in a reference speaker's voice, including in another language, without training a separate model for each speaker.

ComfyUI Frame Interpolation adds AI frame interpolation to ComfyUI workflows for people working with video or animation. It generates frames between existing images to make motion smoother.

kodo coordinates coding agents for developers who have a clear goal and want work to continue unattended for hours. It divides implementation and review across agents and multiple context windows.

CyberScraper 2077 turns web pages into structured data through a conversational interface. It's for analysts and researchers who want to describe the information they need and export the results.

SUB/WAVE is a self-hosted internet radio station for people who want to broadcast music from their own library. An AI DJ picks tracks and speaks between them while every listener hears the same live Icecast stream.

OpenHands is an AI coding agent platform for developers and teams that want agents to carry out code changes and recurring engineering work. Agent Canvas provides a control center for agent conversations and automations.

iAi Personal Memory Engine gives AI assistants persistent memory on your machine. It's for people using coding agents who want past conversations, project details and preferences available across sessions.

agentchattr is a local chat server for developers coordinating multiple AI coding agents. Humans and agents share a conversation and can mention one another to trigger responses without carrying messages between terminals.

iCode is a terminal development workspace for developers who want to work with AI agents and inspect their changes. It brings conversations, agent workflows and a working shell into one interface.

Pi Interactive Shell lets developers give the Pi coding agent control of terminal programs that need ongoing input. You can watch the session in an overlay and take control when a task needs your attention.

Pathrule gives AI coding agents project knowledge that stays attached to the relevant workspace and file paths. Memories, rules and skills can follow a repository across agents and sessions, so developers can retain decisions and constraints without pasting the same instructions into each conversation.