Local AI Apps and Tools for Linux

Lexora is a personal desktop AI agent for research, creative projects and everyday planning as well as coding. It works toward a goal while you give direction and review its work.

DeskcommCRM is a self-hosted CRM for businesses selling through WhatsApp. Its AI agents handle customer conversations, qualify leads and support sales within the CRM.

bitsandbytes is a Python library for developers who need to run or fine-tune large language models on their own hardware with less memory. It works within PyTorch workflows.

AIRecon automates penetration testing and bug bounty reconnaissance for security testers. It guides an assessment through reconnaissance, analysis, exploitation and reporting, with a terminal interface for following the agent's work.

WhisperJAV generates subtitles for Japanese adult videos on your own computer. It targets difficult audio with quiet dialogue, loud vocalisations and long stretches that can cause speech recognition models to invent or repeat words.

RKLLM is a toolkit for developers building local AI applications on Rockchip boards. It runs language and multimodal models on the chip's neural processing unit (NPU).

Keras is an open-source Python deep learning framework for developers and researchers who want to build and train models without tying their code to one backend. It runs locally on Linux and macOS, with WSL2 recommended for Windows. Its Apache 2.0 license permits commercial use and modification.

Netron visualizes neural network and machine learning models for developers and researchers who want to examine their structure.

USearch is a vector similarity search library for developers building semantic search and recommendation systems within their own apps or servers. Its compact C++ core supports custom similarity rules and has no mandatory dependencies.

DB-GPT is a self-hosted AI data assistant for teams analyzing business data and developers building data applications. It connects plain-language questions to database queries and code-based analysis.

OpenWhispr is a dictation and meeting transcription app for people who want to write by voice and keep searchable records of conversations. It lets you choose local processing or cloud providers.

AutoRAG Agent searches documents and connected archives where they already live, then reads the relevant sources to produce answers with file, page or line references. It runs on macOS, Windows and Linux and suits people researching information spread across local files, messages and notes.

SeedVR is an AI video restoration project for developers and researchers processing real-world footage or AI-generated video on their own GPUs. Its SeedVR2 model restores footage in a single diffusion step, with substantial hardware demands in the supplied implementation.

LightEval is a Python toolkit from Hugging Face for developers and researchers comparing LLMs or investigating where their responses fail. It evaluates models already loaded in memory as well as models accessed through a service.

ExLlamaV2 and V3 are local LLM inference libraries for developers building AI applications or hosting models on consumer GPUs. V2 is archived for now and isn't currently maintained; development continues in V3.

Vibe is a desktop app for people who need transcripts or subtitles from recordings without uploading them to a transcription service. It handles audio and video locally, including interviews, meetings and material in different languages.

XTTS v2 generates speech from text on your own hardware, using a voice recording as a reference. It's for developers adding speech to applications and researchers adapting a speech model to their own data.

Roboflow Inference runs computer vision models on images and camera feeds for teams building inspection, monitoring and image analysis systems. You can host it on your own computer, server or edge device.

Ringer coordinates parallel AI coding agents on your machine. It's for developers who want to divide implementation work among workers and judge the results with executable checks.

Lethe is a local document de-identification app for people who work with confidential contracts, client records or deal documents and want to use AI without sharing the names involved. It replaces names with consistent placeholders, then restores them in AI-generated replies, including summaries and translations.

gpt-oss is a pair of OpenAI reasoning models for developers who want to run a local LLM or serve models on their own hardware. The smaller model targets local and specialized applications; the larger one targets general-purpose tasks that need more reasoning.

TUUI is a desktop AI chat application and Model Context Protocol (MCP) client for people who want to use model-connected tools in one interface. Developers can also extend it to build their own desktop AI applications.

KaaS is a self-hosted AI knowledge base for personal research and teams preserving knowledge across role changes. It turns notes, documents and transcripts into wiki articles you can read, edit and query.

RAGFlow helps teams build AI agents that answer questions using their own documents. It extracts content from complex files and retrieves supporting material that readers can check.

PDF Editor Offline helps people edit and prepare sensitive documents on their own computer. It works offline without an account, and desktop and source modes process documents on the device without uploads or document telemetry.

NLM Memory collects coding conversations into one searchable store on your machine. It's for developers who switch agents or editors and need earlier reasoning to remain available when decisions change.

Unstructured is a document processing library for developers preparing files for LLM applications. It turns text documents and images into structured output that applications can work with.

Unsloth is a desktop app for people who want to chat with models, train them on their own data, and create media on their own hardware. Its no-code interface brings these tasks into one workspace.

MemOS gives AI agents persistent memory across conversations and tasks. Developers can use it for assistants that recall preferences, support history or earlier work, with on-device, self-hosted and hosted storage options.

AI Toolkit (ostris) is a training suite for people fine-tuning image and video generation models on their own hardware or rented servers. It provides a browser interface and command-line access to training jobs.

OpenAgent is a personal AI assistant for people and teams who want agents to work with their documents and carry out tasks on their own computer or server.

AWS MCP Servers connects coding assistants and AI agents to AWS documentation, infrastructure tools, and cloud services. It's for developers who want their assistant to work with AWS resources and service-specific guidance.

diffusion-pipe trains image and video diffusion models on your own GPU hardware. It's for people fine-tuning models that are too large to fit on a single GPU or who want to distribute training across several GPUs.

Easy Diffusion generates and edits images on your computer through a browser interface. It's for people who want to use Stable Diffusion without assembling its software components themselves.