2,000+ AI tools you can run locally Add tool

llamafile

A local LLM runner bundles a model and runtime into one executable that works across operating systems and CPU architectures without installation.

Screenshot of llamafile website

llamafile packages a language model and its runtime in a single executable for people who want to run models locally or share a ready-to-run model with others. Recipients don't need to install a separate runtime.

It combines llama.cpp with Cosmopolitan Libc to run on most operating systems and CPU architectures. The same packaging approach lets developers create their own llamafiles, and prebuilt files provide a starting point for users. Models run on the user's hardware, with support for compatible GPUs.

The project is open source under Apache 2.0. Its changes to llama.cpp use MIT, matching that project's license.

Local Model Runners Speech-to-Text and Transcription macOS Windows Linux AI for a modest PC GGUF Hugging Face integration llama.cpp backend

Similar to llamafile

LM Studio

91 videos

A local LLM app runs downloaded models for chat and agent tasks, with MLX and llama.cpp support and voice transcription processed on your device.

lmstudio.aiComputer and Browser Agents

macOS · Windows · Linux#llama.cpp backend#MCP#MLX

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

Computer and Browser AgentsDesktop Chat AppsLocal Model RunnersPersonal AI AssistantsSpeech-to-Text and Transcription

Lemonade

2 videos

A local AI server runs chat, image and speech models on Windows, macOS and Linux, with compatible APIs for apps and optional cloud routing.

6.2KUpdated 20 hours agoApache-2.0

macOS · Windows · Linux · iOS · Android · Docker#GGUF#Hugging Face integration#llama.cpp backend

Lemonade is a local AI server for people who want to chat with models on their own hardware or use them in apps and agents. It includes a built-in interface for direct use and APIs for connecting other software.

Image Generator AppsInference Servers and ClustersLocal Model RunnersSpeech-to-Text and TranscriptionText-to-Speech and Audiobooks

Izwi

A local voice AI runtime for macOS, Windows and Linux, with transcription, voice cloning and OpenAI-compatible APIs that need no cloud service.

462Updated 1 day agoApache-2.0

macOS · Windows · Linux · Web#Forced alignment#OpenAI-compatible API#Speaker diarization

Izwi is a local voice AI app and runtime for people and teams processing speech on their own hardware or inside infrastructure they control. It brings audio tools and voice conversations into a desktop app, browser interface, CLI and inference server.

Local Model RunnersSpeech-to-Text and TranscriptionText-to-Speech and AudiobooksVoice AssistantsVoice Cloning and Voice Changers

Pocket AI Lab

A local AI app for iPhone that checks model fit before download and supports offline chat, vision input and on-device Whisper transcription.

13Updated 2 weeks agoMIT

iOS#GGUF#Hugging Face integration#llama.cpp backend

Pocket AI Lab runs AI models on an iPhone and helps you judge which ones the phone can handle. It's for people who want private chat on their device and want to check memory and storage before downloading model weights.

Local Model RunnersMobile Chat AppsModel Hubs and DownloadersOn-Device and In-Browser AISpeech-to-Text and Transcription

GPT4All

2 videos

A local AI chatbot runs GGUF models and private document chat on Windows, macOS and Linux without requiring a GPU or cloud API.

77.3KUpdated 1 year agoMIT

macOS · Windows · Linux · Docker#GGUF#llama.cpp backend#OpenAI-compatible API

GPT4All is a local AI chatbot for people who want language models and document conversations on their own computer. Model inference and LocalDocs processing run on the device without a cloud connection.

Chat With Your DocumentsDesktop Chat AppsInference Libraries and BindingsInference Servers and ClustersLocal Model Runners

Ollama

261 videos

An MIT-licensed local LLM runner and API for macOS, Windows, Linux and Docker, with optional cloud inference and coding agent integrations.

186.9KUpdated 21 hours agoMIT

macOS · Windows · Linux · Docker#GGUF#llama.cpp backend#Multimodal input

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

Inference Servers and ClustersLocal Model Runners