Apps to Run LLMs Locally

text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.

Lucebox is a local AI workstation for developers and teams who want to run models on their own hardware. Its inference engine is also available separately for supported AMD and NVIDIA machines.

Vyact is a desktop workspace for people who want a local LLM to help with files, writing and code. It brings conversations and searchable documents together, with optional connections to email services and Chrome.

DeepImageJ brings pretrained neural networks into ImageJ and Fiji for life-science researchers who want to analyze microscopy images without writing code or learning how to train models. It runs image-to-image predictions on your own computer, using a standard CPU or a compatible GPU.

KoboldCpp runs language models on your own hardware for chat, creative writing and roleplay. It's a fork of llama.cpp with a bundled KoboldAI Lite browser interface.

llmserve is a terminal app for people who keep local LLM models across several folders or inference tools. It brings model discovery and server management into one interface so you can choose an existing model and an available backend.

Lollms WebUI is a local AI interface for writing, coding assistance and media generation through a choice of models. The project receives minimal maintenance, and its interface has no built-in user authentication.

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

FastLLM is an open-source inference engine for people running large language models on their own machines or self-hosted servers. Its main draw is hardware flexibility: large mixture-of-experts (MoE) models can spread their weights across GPU memory, system RAM and disk when they don't fit entirely on a graphics card.

PocketPal AI runs language models on phones and tablets for people who want an assistant they can use without sending conversations to a server. Core chat works offline after a model download and doesn't require an account.

LLM Farm is an app for on-device AI conversations and comparing language models on Apple hardware. It suits people who want offline chat or need to assess which model fits a project.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

Lemonade is a local AI server for people who want to chat with models on their own hardware or use them in apps and agents. It includes a built-in interface for direct use and APIs for connecting other software.

Zeraix is a local AI desktop for people who want models to work with their files and carry out multi-step tasks. It combines chat, project tools, and agents in one workspace.

Locally AI is a native assistant for people who want to use language and vision models on their own Apple devices. It handles text, images and spoken conversations without sending AI processing to a cloud service.

TensorSharp runs local AI models for .NET developers and people who want chat, media generation and agent tools on their own hardware. You can embed it in a C# application or use its CLI, browser interface or companion app, TensorAgent.

RamaLama runs AI models for local chat or a self-hosted REST API. It's for developers who want a container workflow for trying models on their own hardware and serving them in production.

Llama Desktop runs language models on your computer for private chat and use in other apps. It's for people who want a local ChatGPT alternative and developers connecting coding agents, editors or scripts to their own models.

Osaurus runs AI agents on your Mac for tasks such as reviewing documents, organizing files, and writing code. It keeps agent memory on your computer, so you can change models without losing the context of your work.

Backyard AI is a desktop AI app powered by llama.cpp. The desktop app is deprecated and no longer supported, which limits its suitability for people choosing software for ongoing use.

SwarmLLM is a ChatGPT alternative for people who want to run AI models on their own hardware. It can use a single computer or combine several machines to handle a model that won't fit on one.

BitNet is Microsoft's local LLM inference framework for developers and researchers working with compatible 1-bit models. Its bitnet.cpp runtime focuses on faster inference and lower energy use on your own hardware.

Magnitude is a local LLM engine for people who want to run AI agents on their own hardware. It adapts model execution to your machine and connects to coding assistants you already use.

GPT4All is a local AI chatbot for people who want language models and document conversations on their own computer. Model inference and LocalDocs processing run on the device without a cloud connection.

ChatLLM Web is a browser app for people who want AI help with text and code while keeping their working data on their device. It combines chat, model selection, and an agent that can work with files you choose.

Deltafin runs full Kimi K3 on a single device for researchers and developers exploring large models on their own hardware. It preserves the original expert weights and complete expert bank, but responses are slow and long conversations take substantially longer than short completions.

Pooled runs a single open model across laptops, desktops and phones in browser tabs. It lets people combine their devices' memory to use a model that wouldn't fit on one device, for shared chat or coding tasks.

LocaLM runs AI models on your own hardware for chat and optional tasks such as coding, document questions and media generation. It's for people who want a single local tool and can choose which extra capabilities to add.

Pocket AI Lab runs AI models on an iPhone and helps you judge which ones the phone can handle. It's for people who want private chat on their device and want to check memory and storage before downloading model weights.

Cactus is an on-device AI engine for developers adding automation to mobile apps, wearables and other small devices. Its Needle model turns requests into tool calls locally, including when the device has no internet connection.

llama-swap is a local AI proxy for people who want several models available to their apps without keeping them all loaded. It starts the server a request needs and replaces the active server when another model is requested.

Docker Model Runner lets developers run AI models on their own computers or servers and connect them to applications. It combines local inference with model distribution through container registries.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

OpenLLM is a self-hosted LLM server for developers connecting applications to models on their own hardware or servers. Its OpenAI-compatible interface lets existing clients use those models without adopting a separate API.