Local AI Apps and Tools for Linux

AI apps, servers and tools for Linux desktops and servers. Most projects in this directory support Linux.

800+ tools
A local AI research assistant uses Ollama to investigate web sources, save retrieved content with links, and answer questions about its findings.

3KUpdated 2 months agoMIT

macOS · Windows · Linux#Human approval#Ollama integration#RAG

Wallfacer

1 video
A local AI coding session manager for Claude Code, Cursor CLI, Kiro CLI and Codex, with search and resume tools on macOS and Linux.

117Updated 3 months agoMIT

macOS · Linux#Resumable workflows

Favicon of memU

memU

1 video
An AI agent memory system for Codex, Claude Code and Cursor, with source-linked Markdown records, local storage and a separate cloud service.

14.6KUpdated 2 days ago

macOS · Windows · Linux#Agent Skills#Persistent memory#RAG

A self-hosted AI platform connects document search, agents and customer chat, with local models through Ollama or cloud providers.

869Updated 1 day agoApache-2.0

Linux · iOS · Android · Docker · Web#Human approval#MCP#Multi-user access

A local AI desktop workspace for documents, email and code, with GGUF and Apple Silicon MLX models and optional cloud providers.

48Updated 1 day agoAGPL-3.0

macOS · Windows · Linux · Browser Extension#Code execution#GGUF#llama.cpp backend

Favicon of Typesense

Typesense

2 videos
An open-source search engine combines typo-tolerant keyword and semantic search, with self-hosting, built-in RAG and optional managed cloud hosting.

27.1KUpdated 1 day agoGPL-3.0

macOS · Linux · Docker#Hybrid search#Multimodal input#RAG

A free MIT-licensed desktop AI agent for Windows and Apple Silicon macOS that uses cloud model APIs to work with files, documents and apps.

2.3KUpdated 4 weeks agoMIT

macOS · Windows · Linux#Agent Skills#Code execution#LLM tracing

An open-source ImageJ and Fiji plugin that runs pretrained image analysis models locally on CPU or GPU, with BioImage Model Zoo support.

100Updated 1 month agoBSD-2-Clause

macOS · Windows · Linux#Image-to-image#ONNX

Local speech editing and text-to-speech software clones voices from a few seconds of reference audio and offers a Gradio interface and Docker support.

8.6KUpdated 6 months ago

Windows · Linux · Docker · Web#Hugging Face integration#Voice cloning

A self-hosted AI platform for document assistants and agents, with Ollama and vLLM support, cloud model connections and an OpenAI-compatible API.

518Updated 3 months agoApache-2.0

Linux · Docker · Web#Knowledge graphs#MCP#Multi-user access

A self-hosted .NET AI agent framework supports cooperating agents, knowledge retrieval and MCP tools, with an Apache 2.0 license.

3.1KUpdated 2 days agoApache-2.0

macOS · Windows · Linux · Web#Code execution#MCP#Multi-agent workflows

Favicon of koboldcpp

koboldcpp

4 videos
A local LLM runner for GGUF models on Windows, macOS and Linux, with CPU or GPU support and a browser interface for chat and roleplay.

12.3KUpdated 2 weeks agoAGPL-3.0

macOS · Windows · Linux · Android · Docker · Web#GGUF#Hugging Face integration#llama.cpp backend

A self-hosted LLM gateway for Linux, macOS and Windows that connects Ollama, vLLM and cloud APIs through an OpenAI-compatible interface. Apache 2.0 licensed.

108Updated 1 month agoApache-2.0

macOS · Windows · Linux#Ollama integration#OpenAI-compatible API#Streaming inference

Self-hosted text-to-speech server runs Chatterbox models on CPU or GPU, with voice cloning and an OpenAI-compatible API.

1.5KUpdated 6 months agoMIT

macOS · Windows · Linux · Docker · Web#Hugging Face integration#Multilingual#OpenAI-compatible API

A self-hosted photo manager with face recognition and semantic image search that supports RAW photos and videos and runs through Docker.

8.2KUpdated 1 day agoMIT

Windows · Linux · iOS · Android · Docker · Web#Multi-user access#ONNX#Semantic search

A local LLM server manager for macOS and Linux that discovers GGUF and MLX models and runs them through installed inference backends.

421Updated 6 days agoMIT

macOS · Linux#GGUF#Hugging Face integration#llama.cpp backend

A self-hosted AI assistant with sandboxed agents, persistent memory and approval-based credential access that connects to your chosen LLM provider.

204Updated 2 days ago

Linux · Docker · Web#Code execution#Guardrails#Human approval

A local MCP runtime gives coding agents structured file reading, repository search and batch edits, with optional Bash jobs.

1.5KUpdated 5 days agoApache-2.0

macOS · Windows · Linux#Batch processing#Code execution#Human approval

A self-hosted AI document assistant with cited answers and agent workflows that can run fully offline through Ollama, vLLM or llama.cpp.

18.4KUpdated 1 day agoMIT

macOS · Windows · Linux · Docker · Web#Human approval#Hybrid search#llama.cpp backend

A Python framework for AI agent workflows that connects Codex, Claude, Kimi, and Pi in dependency graphs and runs agents in local Docker or on remote machines.

1.4KUpdated 2 weeks agoMIT

Linux · Docker · Web#Agent Skills#Batch processing#Code execution

A local LLM web interface with GGUF, Ollama and cloud API support, local chat storage, and image, video and music generation.

4.8KUpdated 4 weeks agoApache-2.0

macOS · Windows · Linux · Docker · Web#GGUF#Hugging Face integration#llama.cpp backend

A self-hosted legal AI agent that reviews and drafts contracts with cited answers and Word tracked changes, using local or cloud models.

82Updated 23 hours agoGPL-3.0

macOS · Windows · Linux · Docker · Web#Batch processing#Guardrails#Human approval

An AI research plugin for Zotero that searches your library, compares papers and saves research notes using offline local models or cloud services.

2.7KUpdated 1 day agoAGPL-3.0

macOS · Windows · Linux#Agent Skills#Batch processing#Hugging Face integration

A free, open-source Python library for topic modeling and document similarity on Linux, Windows and macOS, licensed under LGPL-2.1.

16.5KUpdated 1 year agoLGPL-2.1

macOS · Windows · Linux#Distributed execution#Semantic search

Favicon of Unstract

Unstract

4 videos
A no-code document extraction platform that turns PDFs and scans into JSON. Self-host with Docker and Ollama, or use managed cloud hosting.

7.4KUpdated 1 day agoAGPL-3.0

macOS · Linux · Docker · Web#MCP#Ollama integration#OpenAI-compatible API

An open-source Python time series framework for forecasting and anomaly detection. Runs on macOS, Linux and Windows under the BSD-3-Clause license.

10.1KUpdated 22 hours agoBSD-3-Clause

macOS · Windows · Linux

Self-hosted knowledge base for linked notes and tasks, with Ollama chat, semantic search, and Obsidian export. Open source under MIT.

5Updated 1 day agoMIT

macOS · Linux · Web#Knowledge graphs#MCP#Multi-user access

Favicon of Klaat Code

Klaat Code

1 video
A terminal AI coding agent that edits local projects, uses hosted model routing, and supports a separate OpenAI-compatible endpoint.

353Updated 2 months ago

macOS · Windows · Linux#Browser automation#Code execution#Git integration

An open-source LLM pretraining library built on PyTorch, with custom dataset support and distributed training on NVIDIA GPUs.

2.9KUpdated 1 month agoApache-2.0

Linux#Distributed execution#Hugging Face integration

Favicon of Reins

Reins

1 video
An open-source Ollama chat client runs on mobile and desktop, with separate model settings for each conversation and support for images.

559Updated 1 month agoGPL-3.0

macOS · Windows · Linux · iOS · Android#Multimodal input#Ollama integration

A self-hosted AI studio that runs agents, document chat and media generation on your Linux GPU, with offline operation and an MIT license.

320Updated 19 hours agoMIT

Linux · Web#Git integration#Hybrid search#LoRA

An open-source graph and vector database for AI memory and RAG, with full-text search and embedded or self-hosted deployment under Apache 2.0.

6.3KUpdated 1 day agoApache-2.0

macOS · Windows · Linux · Docker#Agent Skills#Hybrid search#Knowledge graphs

A desktop AI assistant for Windows, Linux and macOS that runs local Ollama models or uses cloud APIs, with agents, file search and code execution.

2KUpdated 1 month ago

macOS · Windows · Linux#Agent Skills#Code execution#MCP

Favicon of pgvector

pgvector

11 videos
A Postgres extension that stores and searches vectors alongside application data, with exact search and optional HNSW or IVFFlat indexes.

23.7KUpdated 2 days ago

macOS · Windows · Linux · Docker#Semantic search

Favicon of LogotyperLogotyper
Got an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
Favicon of Logotyper
Favicon of LogotyperLogotyper
Got an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
Favicon of Logotyper