Local AI Apps and Tools for Linux

Goose is a general-purpose AI agent that runs on your computer. It suits people who want an agent for coding, research, writing, automation, or data analysis, without committing to one model provider. The desktop app runs on macOS, Windows, and Linux; there's also a CLI for terminal work and an API for use in other software.

MinerU parses documents locally into structured text for AI agents, RAG systems and knowledge bases. It's for people working with scanned PDFs, academic papers and Office files whose tables, formulas or page layouts need more care than plain text extraction.

Ollama runs language models on your own computer or server. It provides a command-line runner and a local API for people building AI applications or connecting existing tools to models they host themselves. The software is distributed under the MIT license.

LocalAI runs language models, speech, vision and image generation on hardware you control. It's for developers and teams that want a self-hosted AI server for their apps without sending model requests to a cloud service. Its OpenAI-compatible API works with existing clients, and it also accepts Anthropic, Ollama and ElevenLabs API calls.

Zed is a native code editor for developers who want AI coding assistance and collaboration in the same desktop app. It runs on macOS, Linux, and Windows, with a minimal interface and a focus on responsive editing. Its AI agents can work in parallel on tasks that involve editing files, exploring code, and running tools.

Unsloth brings model training and everyday AI use into a desktop app for people who want to run models on their own hardware. Its no-code interface covers chat, fine-tuning and media generation on macOS, Windows and Linux. The Unsloth software is open source under Apache 2.0.

Hunyuan3D generates textured 3D assets from reference images or text and can run on your own computer. It's for 3D artists, hobbyists and developers who want AI-generated meshes they can use in other software. It supports macOS, Windows and Linux; Hunyuan3D Studio is a separate hosted option.

Off Grid AI runs language models on iOS, Android, macOS, Windows and Linux. You can chat, analyze documents and generate images on your own hardware. The mobile app uses the MIT license, while the desktop app uses AGPL.

PicApport is a self-hosted photo server for families and businesses that want a searchable media archive on their own hardware. Its AI tagging add-on recognizes image content without sending photos to a cloud service and saves the resulting tags in image metadata. The server runs on Windows, Linux or macOS, with a Docker image available, and you access the gallery through a browser.

ScribeDog is a Markdown editor for writers and note-takers who want AI assistance while keeping their documents on their own hardware. It displays formatted text, tables and images instead of Markdown syntax, but saves ordinary .md files that work with Git and other editors. It has a native desktop app and a self-hosted Server Edition available through Docker.

Pi is a terminal-based coding assistant for developers who want to shape the agent around their own workflow. Its core stays small, while extensions can change its tools, commands and terminal interface. It's open source under the MIT license.

agent-browser gives AI agents a compact text view of a browser page, with references that identify the exact elements they can interact with. It's for developers who want coding assistants or other agents to use websites without filling their context with a full page's HTML. The open source tool runs locally on macOS, Linux and Windows under the Apache 2.0 license.

OpenWhispr is a free, MIT-licensed dictation and meeting transcription app for people who want voice input across their apps with control over where processing happens. It's available on macOS, Windows, Linux and iOS. Local transcription works offline and keeps audio on your device; optional cloud transcription sends audio to the selected provider, whose retention policies apply.

Photoview is a self-hosted photo gallery for photographers and households who keep their pictures on a personal server or NAS. It turns existing folders into browser-based albums and automatically scans for added photos and videos. Your folder structure determines how the library appears, so you can keep organizing files through Samba, FTP or Nextcloud. Your media stays on your server.

GoModel is a self-hosted AI gateway for developers and platform teams that want one API for local models and cloud providers. It accepts OpenAI- and Anthropic-compatible requests, so applications can keep their existing SDKs while the gateway handles provider selection and usage controls.

One API is a self-hosted LLM API gateway for developers and teams that want to share model access across apps or users. It puts cloud providers and Ollama behind an OpenAI-compatible API, so clients can use one endpoint across different backends. It's open source under MIT and runs on your own server as a single executable or in Docker.

picoLLM is an on-device inference SDK for developers building apps that run compressed language models on users' hardware. It generates text locally, so prompts don't need to go to a cloud inference service. Its main distinction is Picovoice's compression method, which learns how to allocate precision across model weights rather than applying a fixed allocation.

LLMKube is a free, open-source Kubernetes operator for teams and homelab owners running local LLM inference across their own hardware. It manages Linux GPU servers and Apple Silicon Macs together, so a mixed fleet can serve models through the same platform. It uses the Apache 2.0 license.

Wyoming Satellite connects a microphone and audio playback device to Home Assistant through the Wyoming protocol. It's for people building a self-hosted voice assistant with a separate device for speaking and listening. The project is archived and no longer maintained; its replacement is Linux Voice Assistant, which uses the ESPHome protocol.

ROCm is AMD's open-source GPU computing platform for developers running AI training, inference and scientific workloads on their own hardware or servers. It supports selected Linux and Windows configurations on AMD Instinct, Radeon and Ryzen AI devices. Check the version-specific GPU, operating-system, driver and firmware compatibility matrix before installing. It's the software foundation for applications that need AMD GPU acceleration, including local LLM workloads.

Demucs separates a finished song into vocals, drums, bass and the remaining accompaniment on your own computer. It's for musicians who need individual stems or a vocal-free backing track, and developers building audio tools. The project is archived and no longer maintained. Its Python code is open source under the MIT license.

Seed-VC changes recorded speech or singing to sound like a voice supplied in a short reference clip, without training a separate model for that speaker. It runs locally on Windows, Linux and Apple Silicon Macs, with uses in audio production, live streaming and online meetings. The project is archived and no longer maintained.

AI Render is a Blender add-on that uses your scene and a text prompt to generate an image with Stable Diffusion. It's for Blender artists who want to use their 3D work as the basis for AI images and explore different treatments within the application they already use.

mcp-proxy is a self-hosted tool for connecting AI clients and MCP servers that use different connection types. It's for developers who need a stdio client, such as Claude Desktop, to reach an SSE or Streamable HTTP server, or who want remote clients to access a local stdio server. The proxy runs on your own machine or server.

digiKam is a local photo manager and image editor for photographers who need to organize large collections of photos, RAW files and videos. It runs on Linux, Windows and macOS and is open-source software under GPL-2.0. Its archived GitHub mirror points contributors to the maintained KDE repository.

Kangaroo is a desktop SQL client and database administration app for developers and database administrators who work across different database systems. It runs on Windows, macOS and Linux and includes an AI assistant for help with database problems alongside its query and design tools.

DeepStack is a self-hosted computer vision API for developers adding image analysis to camera systems, home automation or other applications. It runs prebuilt and custom models on your own hardware and works fully offline. Image processing stays on the device or server where you host it, with no cloud service required.

CodeProject.AI Server gives developers a shared API for AI tasks that run on their own hardware. It's a self-hosted service for adding image analysis, text processing and generation to applications. Processing stays on the machine running the server, without cloud calls or sending data outside your device or network.

OpenAgent is a self-hosted personal AI assistant that combines document search with agents that can act on your behalf. It's for people who want an assistant on their own computer or server, and teams building agents around their documents and workflows. It runs natively on Windows, macOS and Linux as a single executable. It's free and open source under Apache 2.0.

Fooocus is a free, open-source AI image generator for people who want to create images on their own computer without spending much time tuning settings. It uses Stable Diffusion XL and automatically expands prompts with a local GPT-2 engine. Generation works offline once the required models are downloaded, so prompts and images can stay on your machine.

h2oGPT is a self-hosted ChatGPT alternative for people who want to chat with local models and ask questions about their own documents. The project is archived and no longer maintained. It's open source under Apache 2.0, with support for Linux, macOS, Windows and Docker.

Reor is a local AI note-taking app for people who want to search their own writing, find connections between ideas and ask questions about their notes. The project is archived and no longer maintained. It runs on macOS, Windows and Linux, and it's open source under AGPL-3.0.

QAnything is a self-hosted knowledge base for people and teams who want to ask questions about their own documents, including collections that mix Chinese and English. It can answer in either language regardless of the document's language, and runs locally through Docker on Windows, macOS and Linux.

Discord Ollama Bot connects locally hosted language models to Discord, so a community can use an AI assistant inside its existing chat server. It's for server owners who want to choose and host the models themselves while keeping Discord as the interface. Model inference runs on your hardware, but conversations still pass through Discord, so this isn't a fully offline chat app.

FluxGym is a local web interface for training FLUX LoRAs on your own images, with support for GPUs with 12GB, 16GB or 20GB of VRAM. It's for people who want to customize an image model through a browser while retaining access to detailed training controls. It runs on Windows and Linux, with Docker support, and is open source under the MIT license.

OpenedAI Speech is a self-hosted text-to-speech server for developers who want local speech generation in apps built around OpenAI's speech API. The project is archived and no longer maintained. It's open source under AGPL-3.0, and it generates audio on your own hardware without an OpenAI API key.