Local AI Apps and Tools for Linux

olmOCR converts scanned and image-based documents into text for researchers and developers preparing LLM datasets. It handles pages whose layout makes ordinary text extraction difficult.

Magnitude is a local LLM engine for people who want to run AI agents on their own hardware. It adapts model execution to your machine and connects to coding assistants you already use.

GPT4All is a local AI chatbot for people who want language models and document conversations on their own computer. Model inference and LocalDocs processing run on the device without a cloud connection.

spaCy is a Python library for developers and data scientists who need to extract structured information from text in their own applications. It runs on macOS, Windows and Linux, with model packages that become part of your application. It's free and open source under the MIT license.

NextChat is an AI chat interface for people who want to use self-deployed LLMs and cloud models in one application. It connects to LocalAI and RWKV-Runner, and supports OpenAI, Claude, Google Gemini and DeepSeek.

CleanStream filters unwanted speech in live OBS audio for streamers and people recording spoken content. It runs speech recognition on your machine with Whisper through whisper.cpp, and introduces a playback delay while it decides which audio to keep.

ilastik is a desktop tool for researchers who need to identify, classify or count cells and other objects in experimental images. It runs on Linux, macOS and Windows. Its main draw is interactive training: you mark examples in an image with brush strokes and see predictions as you work, without needing machine learning expertise.

Crush is a terminal AI coding assistant for developers who want an agent to work with their code and existing tools. The application runs on your machine; your chosen backend determines where model requests go.

Parrot is an open-source desktop app that reads selected text aloud in other applications. It's for people who prefer listening to written material or need text-to-speech for accessibility. It runs on macOS, Windows and Linux, and builds on Handy by CJ Pais as an MIT-licensed fork.

Dive is a desktop AI agent for people who want a language model to work with files, shell commands and connected tools. It supports models with function calling and acts as a host for Model Context Protocol (MCP) servers.

YuE is an AI music generation project for songwriters, musicians and developers who want to create songs with vocals and accompaniment. Its YuE2 models produce an editable composition before rendering the audio, giving you control over the music behind the recording.

JARLIS is a self-hosted AI email assistant for people who want help sorting their inbox while keeping control over outgoing replies. It prepares drafts for review, flags messages that need attention and archives low-priority mail. It never sends replies automatically.

Quicksand gives AI agents a Linux virtual machine for executing code and working with desktop apps on your own hardware. It's for developers who need a separate operating system for agent tasks, controlled through an async Python API.

Tel-Agent is an AI receptionist for businesses that want phone calls and customer messages handled by one agent on their own server. Recordings and transcripts stay on your machine, but its voice setup uses Deepgram, a cloud LLM and ElevenLabs, requiring internet access and your own API keys.

Whats Reader lets you revisit exported WhatsApp conversations and their attachments without sending the files to a service. It works with individual and group chats, so you can review old conversations or find details buried in messages and voice notes.

WayVoice is a local AI dictation app for Linux users who want to enter text by speaking in their desktop applications. It processes speech on your machine, with no cloud service required for recognition.

Multi-Agent Shogun runs and coordinates separate AI coding assistants on your computer or a Linux server. It's for developers dividing implementation and research across parallel tasks. Coordination happens locally, but Claude Code’s standard cloud connection sends prompts and model outputs over the network to their model provider; other agents use their chosen CLI's model access and authentication.

Blinko is an AI note app for people who want to capture passing thoughts and find them again later. Its self-hosted edition stores notes and data in your own environment.

3D Gaussian Splatting reconstructs photographed scenes so you can view them from new angles. It's the authors' reference implementation for researchers and developers working on 3D capture, with support for complete scenes and distant backgrounds.

OpenCrust is a self-hosted AI assistant platform for people who want agents to handle tasks through their messaging apps. Named agents can pass work to one another and retain conversation memory between sessions.

Helix is a paid, self-hosted platform for engineering teams coordinating coding agents. Agents work on separate tasks in parallel, while the team shares a view of their progress and reviews their work.

Chatterbox is a text-to-speech model family for developers and creators who want to generate voices on their own hardware. It suits narration, voice agents and interactive media, with models for English and multilingual speech.

llm-fw inspects model requests for developers and teams using AI tools, SDKs and agents. It blocks suspected prompt injection and removes outgoing secrets before forwarding approved traffic to the model endpoint.

Deepchecks is a Python toolkit for data scientists and ML teams checking datasets and models before deployment and watching for problems in production. Its testing, CI and monitoring components reuse the same checks across those stages.

OpenBitFun is a desktop AI agent workspace for coding and other tasks that use files and shell commands on your machine or a selected SSH host. It runs on Windows, macOS and Linux. Model requests go to the configured provider; built-in cloud connections send them to external services, and custom providers are also supported.

PentAGI automates authorized penetration testing for security engineers, researchers and red teams. Its specialized AI agents turn a target and a plain-language goal into testing work you can follow through a web interface.

RisuAI is an AI roleplay client for people who want to create characters and fictional worlds, then develop stories through conversation. It supports chats with individual characters or groups.

Infinity is a search database for developers building retrieval-augmented generation (RAG), question answering and recommendation systems. It lets applications combine matches based on meaning with exact text matches and structured filters.

OpenCode is an AI coding agent for developers who want help writing code or exploring unfamiliar projects. You can choose a local model running on your hardware or connect a cloud provider.

RVC WebUI is a local AI voice conversion tool for people who want to change the voice in recordings or use a live voice changer. It also lets you train a voice model from your own recordings.

LEANN is a local vector database for people building AI search over personal data or knowledge collections. It reduces index storage by computing embeddings on demand rather than keeping every embedding on disk.

AgentSight is a local AI agent monitoring tool for developers investigating failed runs, slow steps or unexpected changes. It connects prompts and model calls to what agents actually do on the machine, including activity their own logs may miss.

Phone Harness connects an AI agent to a real iPhone or Android to carry out tasks through app screens. It's for developers who want phone automation without relying on an app API.

Aiursoft Ollama Gateway gives teams controlled access to shared local LLM servers. It connects AI applications and coding assistants to Ollama or OpenAI-compatible backends through a central gateway.