Local AI Apps and Tools for Linux

OASIS is a social media simulator for researchers studying how information spreads, groups polarize, and users follow the crowd. It uses LLM agents as simulated participants in Twitter and Reddit environments.

ThinkRAG answers questions about your own documents using a knowledge base on your laptop. It's for researchers, students and other knowledge workers who want to find information across their files, with particular attention to Chinese text.

AI Infra Guard is a self-hosted AI security testing platform for developers and security teams checking agent workflows, model responses and AI infrastructure. It combines vulnerability scans and adversarial prompt tests in a web interface.

VideoHighlighter is a desktop app for finding useful moments in long recordings without uploading footage for analysis. It helps creators cut highlights, reviewers inspect camera recordings, and interview editors locate material worth keeping.

Triton is a programming language and compiler for developers writing custom GPU computations for deep learning. Its Python-based environment provides control over the kernels behind model operations.

jetson-containers is a Docker container build system for developers running local AI on NVIDIA Jetson. It assembles GPU software and its dependencies into containers for workloads that need a compatible CUDA stack.

Rivet AgentOS is a runtime for developers building applications where AI agents need a working environment for code and tools. It runs inside an existing backend process, with WebAssembly isolation instead of a separate virtual machine for each agent.

Volyx Lens is an open-source desktop AI assistant for macOS, Windows and Linux that lets you choose which screen, microphone and system-audio inputs reach your AI provider. Linux support is experimental, with meeting audio captured on a best-effort basis. It's for people who want help with visible code, documents or meetings without continually copying context into a chat. A movable floating rail expands into chat and collapses when you don't need it.

GameStringer translates games for players and fan translators who want a language the game doesn't include. It detects the engine, extracts text and applies translated text to the game, with compatibility depending on the engine and title.

NotebookLlama is a self-hosted NotebookLM alternative for people who want control over the application code while using cloud services to process documents. It relies on LlamaCloud for document extraction and indexing, so self-hosting doesn't make the workflow fully local.

WhisperX is a local speech-to-text tool for transcribing interviews, meetings and long recordings. It builds on OpenAI's Whisper, adding individual word timings and optional speaker identification for subtitles and transcript review.

Deltafin runs full Kimi K3 on a single device for researchers and developers exploring large models on their own hardware. It preserves the original expert weights and complete expert bank, but responses are slow and long conversations take substantially longer than short completions.

AudioLDM 2 is a local AI audio generator for sound designers and researchers experimenting with synthetic sound. It uses pretrained models to produce audio from text and provides a Gradio browser interface alongside command-line access.

NoteGen is an AI note-taking app for collecting research, meeting material and ideas before organizing them into finished documents. Notes remain ordinary Markdown files, with attachments stored on your device by default.

Kiln is a desktop workbench for teams building and testing AI applications. Engineers, QA staff and subject matter experts can work with the same tasks and datasets, including contributing ratings and examples without writing code.

ebook2audiobook converts non-DRM ebooks into narrated audio with chapters and metadata. It's for readers who want audio editions of legally acquired books, with a choice of speech engines and narrator voices.

OpenShell is a self-hosted runtime for teams that need autonomous AI agents to work with files and APIs under explicit access limits. It runs agents in isolated sandboxes and enforces policies at the kernel level.

PageLM is a self-hosted AI study platform inspired by NotebookLM. Students, educators and researchers can use it to turn their materials into resources for revision and exam practice.

OpenRig coordinates coding agents for developers working on projects that last weeks or months. You talk to a lead agent, which delegates to specialists and brings back results or decisions that need your attention.

FluxGym is a browser interface for training FLUX LoRAs on your own images. It's for people who want to customize image models locally, with support for GPUs with 12GB, 16GB or 20GB of VRAM.

LocaLM runs AI models on your own hardware for chat and optional tasks such as coding, document questions and media generation. It's for people who want a single local tool and can choose which extra capabilities to add.

Umi-OCR extracts text from screenshots and local images for people who need to copy on-screen text or process image collections without an online OCR service.

Emdash is a desktop development environment for developers who want to delegate several coding tasks at once. It keeps each task's branch, terminal, conversation, and review state together so parallel work stays separate.

TorchAO is a PyTorch library for developers who want to train and run models on their own hardware with less memory. It supports language models and image or video generation, and works with torch.compile and FSDP2 across most Hugging Face PyTorch models.

RealtimeSTT is a Python library for developers building voice assistants, dictation tools and apps that turn live audio into text. It can show text while someone speaks and produce a final transcript when they finish.

mcp-proxy connects AI clients and Model Context Protocol (MCP) servers that use different connection types. It's for developers who need desktop clients to reach remote tools, or want other clients to access a local MCP server.

Fed-BioMed lets hospitals and researchers train AI models across institutions while patient data stays on each institution's own infrastructure. It's a self-hosted platform for biomedical research that needs access to data across multiple sites but faces restrictions on sharing clinical records.

MEX keeps project knowledge alongside code so engineers and their AI coding agents can share context across teammates and sessions. Architecture, requirements and decisions live in readable Markdown that travels with the repository through Git.

LeanCTX helps developers control the information their AI coding tools receive. It runs locally between those tools and project files or command output, while your existing application keeps control of the model and workflow.

Open-LLM-VTuber is an AI companion for people who want to talk with a customizable animated character. Local language and speech models let it work fully offline, with conversations staying on your device.

Marker is a local document converter for developers and teams preparing PDFs, scans and Office files for document processing or AI workflows. It extracts text while retaining structure such as tables, equations and page layout.

AppFlowy is a workspace for documents, projects and AI. Its desktop Local AI plugin connects to Ollama for local model use. AppFlowy also offers a self-hosted server deployment with language and embedding models inside your environment, including air-gapped operation. The desktop plugin and server deployment are distinct ways to use AI.

LoopX is an open-source control plane for AI agents working on multi-day coding, research and personal projects. It preserves the goal and decisions between sessions so work can resume after a pause or handoff.

SymForge is a local MCP server for developers using AI coding agents on large repositories or long source files. It gives agents focused views of symbols and their relationships so they can investigate code without reading entire files.