Local AI Chat Apps and Assistants

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

Link gives AI agents persistent memory so you don't have to repeat preferences, project decisions and context in every session. Multiple agents can read the same local Markdown files, which you can inspect in an editor or Obsidian.

Mirrai is an AI companion for people who want to revisit unfinished conversations through a persona based on someone's chat history. It simulates their communication style, with a farewell process that gives the experience an optional endpoint.

Waku Agent is a personal AI assistant that runs on your laptop, stores its memory locally and calls remote model providers. It's for developers who want to inspect and change the assistant's behavior in Python. The agent uses provider API credentials for reasoning; requests to cloud providers are processed by those services.

Avibe gives coding agents a shared workspace for people who want to manage ongoing work and review results from their browser or phone. Agent execution stays on your machine, while inference uses your configured provider; OpenCode can also use local or OpenAI-compatible endpoints.

Voxta is an AI companion for people who want a character they can talk to, assign tasks to or use in interactive stories. You choose its personality, voice and optional avatar.

FastLLM is an open-source inference engine for people running large language models on their own machines or self-hosted servers. Its main draw is hardware flexibility: large mixture-of-experts (MoE) models can spread their weights across GPU memory, system RAM and disk when they don't fit entirely on a graphics card.

WritHer is a voice dictation app for people who want to write in Windows desktop apps and manage everyday tasks by speaking. It works offline after the initial model downloads, without an account.

MNN is a C++ framework for developers running AI models on phones, PCs and embedded devices. It supports inference and training on the device, with a small application footprint and hardware acceleration.

Sidekick is a native macOS app for people who want AI answers grounded in their documents and research materials. Its built-in llama.cpp engine runs GGUF models such as Qwen3.5 without a separate model runner.

OwnPilot is a self-hosted AI assistant for people who want personal records and agents that can carry out tasks in one web interface. It supports local model backends as well as cloud providers.

Libre WebUI is a self-hosted AI workspace for individuals and teams who want chat, document research and AI agent tasks on infrastructure they control. You can use local models or connect a remote provider of your choice.

QM is a self-hosted AI agent platform for startups that want employees to work with agents individually and in shared channels or projects. Each person and room has its own memory, files, permissions and persistent workspace.

PocketPal AI runs language models on phones and tablets for people who want an assistant they can use without sending conversations to a server. Core chat works offline after a model download and doesn't require an account.

LLM Farm is an app for on-device AI conversations and comparing language models on Apple hardware. It suits people who want offline chat or need to assess which model fits a project.

ZeroClaw is a personal AI agent for people who want an assistant running on their own computer or server. It can use a shell and browser, respond through messaging apps and perform scheduled tasks.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

SpeakoFlow lets you dictate into other apps and ask an AI assistant for help without leaving your work. It's for people who want voice typing, spoken conversations and meeting notes with processing on their own computer.

SapienAI is an academic chatbot and research workspace for researchers who want to keep source material, writing and AI conversations together. Research spaces group project documents, notes and drafts so the AI can answer questions using uploaded material.

RAG Web UI is a self-hosted app for asking questions about your own documents. It's a learning project, and its maintainers advise against commercial use and state that it isn't ready for production.

AgentArk is a self-hosted AI agent runtime for people who want a personal assistant that remembers preferences and carries out ongoing work under their control. It runs through Docker on macOS, Windows and Linux, with a browser interface for chat, tasks and action review. It's free and open source under Apache 2.0.

ChatOllama is an AI agent app with a command-line interface for people who want to use local models or hosted services from the same client. It discovers available models from connected providers, including installed models at an Ollama endpoint.

Priv AI is an on-device assistant for people who want to chat with AI and use it to examine personal health and financial information. It works offline after a model download and doesn't require an app account.

OpenMAIC is a self-hosted AI classroom platform for learners and educators building lessons from a topic or their own materials. AI teachers and classmates explain concepts and discuss questions during the lesson.

py-xiaozhi is a Python AI voice client for people who want to try Xiaozhi conversations on a computer or build voice interaction into hardware projects. It builds on the xiaozhi-esp32 project and lets you use a desktop microphone and speakers without dedicated Xiaozhi hardware.

Phantasm is an iPhone AI chat app for people who want to use models running on their own machines. The phone provides the chat interface, while a backend you control handles inference.

parrot.nvim is an AI coding and text editing assistant for Neovim users who want to request changes and chat without leaving their editor. It builds on an early fork of gp.nvim and lets you choose what context goes to the model.

Agnai is an AI roleplay chat app for people who want conversations with fictional characters, including shared chats with other people. It builds on early work from Galatea-UI by PygmalionAI.

Zeraix is a local AI desktop for people who want models to work with their files and carry out multi-step tasks. It combines chat, project tools, and agents in one workspace.

OpenHarness is a Python framework for developers and researchers building AI agents that can act on files, use tools and retain work across sessions. It includes ohmo, a personal agent that handles coding tasks through Feishu, Slack, Telegram or Discord.

Row-Bot is a local AI assistant for people who want to research, create documents and automate work on their own computer. It combines conversations with memory and agents that can continue working on longer tasks.

Miko is an AI companion for people who want to talk with an animated character on their Windows desktop. It pairs a local language model with a customizable 3D avatar and spoken replies.

Codex iOS Assistant connects Codex on your Mac to your iPhone so the assistant can perform phone actions and retrieve phone context. It's for people who want to bring information from their phone into their work with Codex.

Claw Admin is a web dashboard for people managing OpenClaw Gateway and Hermes Agent. It puts agent conversations, behavior controls and activity monitoring in one browser interface.