Local AI Apps and Tools for Linux

Discord Ollama Bot lets a Discord community chat with language models hosted on the owner's hardware. It's for server owners who want to choose their own models and make an AI assistant available inside Discord.

Anti Slop is a set of skills for developers who want AI coding agents to avoid generic interfaces and filler copy. It checks the agent's work while leaving visual direction to you.

Wyoming Satellite connects a microphone and audio playback device to Home Assistant for a self-hosted voice assistant. The project is archived and no longer maintained; Linux Voice Assistant replaces it using the ESPHome protocol.

Text Generation Inference (TGI) serves LLMs on your own hardware for developers building chat apps and text generation services. The project is archived and no longer receives updates.

Bytebot carries out tasks described in plain language on its own virtual desktop. It's for people automating document work, research, or tasks across several applications. The project is archived and no longer maintained.

Clawlet is a self-hosted personal AI agent for people who want an assistant on their own machine or server. It supports local models and can retrieve past context through optional memory search.

Intel IPEX-LLM is a library for developers running or fine-tuning language models on Intel hardware. The project is archived and no longer maintained, and Intel has identified known security issues in the code.

mods is an AI command-line tool for developers and shell users who want to ask questions about command output or pass model responses into pipelines. The project is archived and no longer maintained.

ROCm is AMD's GPU computing platform for developers running AI training, inference and scientific workloads on their own workstations or servers. It provides the software needed to use AMD GPUs for these workloads, including local LLM inference.