Local AI Apps and Tools for Linux

OpenVINO is an AI inference toolkit for developers deploying models in their own applications. It converts and optimizes models for local hardware or servers, covering generative AI and conventional machine-learning workloads.

Numen provides hands-free voice control and dictation for Linux. It is for people who want to operate their computer through speech, including users who cannot comfortably type or want to reduce hand strain.

Anything Analyzer is a desktop protocol analyzer for developers and security researchers investigating APIs, authentication and request signing. It brings browser and app traffic into one session for inspection and AI analysis.

Granite is IBM's family of AI models for developers and businesses building applications on their own hardware or servers. You can customize the models for enterprise tasks, including coding assistants and document analysis.

InvokeAI is a free, open-source image generation application for artists who want to create and edit artwork on their own hardware. Its locally hosted browser interface combines direct canvas work with repeatable generation workflows.

Avibe gives coding agents a shared workspace for people who want to manage ongoing work and review results from their browser or phone. Agent execution stays on your machine, while inference uses your configured provider; OpenCode can also use local or OpenAI-compatible endpoints.

Xinference serves AI models on your own computer or servers for developers and researchers building applications around models they control. It brings chat, document search and media generation into one platform.

Voxta is an AI companion for people who want a character they can talk to, assign tasks to or use in interactive stories. You choose its personality, voice and optional avatar.

FastLLM is an open-source inference engine for people running large language models on their own machines or self-hosted servers. Its main draw is hardware flexibility: large mixture-of-experts (MoE) models can spread their weights across GPU memory, system RAM and disk when they don't fit entirely on a graphics card.

StarDist detects individual cells and nuclei in crowded 2D microscopy images and 3D volumes. It's for researchers and bioimage analysts who need separate outlines for closely packed objects. Its shape-based approach suits objects that can be represented by star-convex polygons in 2D or polyhedra in 3D.

Voice Changer (w-okada), also called VC Client, converts speech as you talk using AI voice conversion models. It suits people who want live voice changes, including gaming commentators running other demanding applications.

Transcribe Offline turns recordings and live speech into text for people who need to review conversations without uploading audio to a cloud service. It pairs transcript editing with audio playback in a desktop app.

Moondream is a vision language model for developers building apps that interpret images, such as warehouse or manufacturing footage. Its downloadable models can run on your own hardware, including offline in an air-gapped environment.

noScribe transcribes recorded interviews for qualitative researchers and journalists who need to keep audio on their own computer. It processes recordings locally rather than sending them to a cloud transcription service.

Audiblez converts EPUB e-books into spoken audio using Kokoro-82M on your computer. It's for readers who want an audiobook version of a book, with control over the voice and which sections get read aloud.

OwnPilot is a self-hosted AI assistant for people who want personal records and agents that can carry out tasks in one web interface. It supports local model backends as well as cloud providers.

whisper.cpp runs OpenAI's Whisper speech recognition models on your own hardware. It's for developers adding transcription to applications and people who need offline speech-to-text.

Strix is an AI penetration testing tool for developers and security teams assessing code, web applications and APIs. Its free, open source edition runs locally with Docker under the Apache 2.0 license. It supports local models through Ollama or LM Studio, as well as remote providers such as OpenAI and Anthropic; cloud-backed runs send model requests to the selected provider.

Wyoming Piper provides local speech generation for Home Assistant and other Wyoming-compatible clients. It's for people building a voice assistant who want speech synthesis to run on their own machine or server.

NullHub is a self-hosted management console for people running NullClaw and its supporting tools. It brings agent instances, workflow runs and task queues into one browser dashboard.

ZeroClaw is a personal AI agent for people who want an assistant running on their own computer or server. It can use a shell and browser, respond through messaging apps and perform scheduled tasks.

Open Generative AI is an AI image and video studio for creators who want to generate media on their own hardware. Local inference is available only in the desktop app.

OpenVoiceOS is a voice assistant platform for people building smart speakers or adding voice control to their own devices. Its core is a fork of MycroftAI/mycroft-core, and most classic Mycroft skills remain compatible.

SQL Chat is a SQL client for people who want to work with databases using natural language. Its chat interface lets you ask for data and request database changes without writing every SQL statement yourself.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

TabbyAPI is a self-hosted LLM API server for people who want to run ExLlamaV3 models on their own hardware. It’s built for personal projects and small groups; its maintainers don’t recommend it for production servers.

Agent S is a computer-use AI agent framework for developers and researchers building desktop automation. It takes natural-language tasks and operates desktop and web applications through their screen interfaces, without requiring an API integration for each app.

Tonfotos organizes family photos and videos for people whose collections span a computer, external drives and a NAS. It helps you find pictures of relatives and keep family history alongside the archive.

SpeakoFlow lets you dictate into other apps and ask an AI assistant for help without leaving your work. It's for people who want voice typing, spoken conversations and meeting notes with processing on their own computer.

opencodex is a local AI gateway for developers who want to choose which models power their coding assistants. It connects Codex, Claude Code, Claude Desktop and Grok Build to alternative providers while keeping each tool's native interface.

audio.cpp runs audio models locally for developers building speech tools and people generating or processing audio on their own hardware. It brings multiple audio tasks into one C++ runtime built on ggml.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

GPyTorch is an open-source Python library for researchers and developers building Gaussian process models in PyTorch. It runs model inference on your own hardware and can use GPUs to accelerate computation. Its focus is on making Gaussian processes practical at larger scales while leaving room to define custom models. The library uses the MIT license.

AgentArk is a self-hosted AI agent runtime for people who want a personal assistant that remembers preferences and carries out ongoing work under their control. It runs through Docker on macOS, Windows and Linux, with a browser interface for chat, tasks and action review. It's free and open source under Apache 2.0.