Run AI Models in the Browser and on Phones

Maid is an Android AI chat app for people who want to chat with models on their phone and access remote models from the same interface. Local conversations work without an internet connection.

Vosk is an offline speech-to-text toolkit for developers building voice interfaces or transcription software. It processes speech on the device or server running it, without sending audio to a cloud recognition service.

NativeMind is a local ChatGPT alternative for people who want AI help with reading and writing inside their browser. It processes prompts and page content on your device using local models.

Layla is an AI assistant for people who want private chat, a personal companion or character roleplay on their phone. It runs local models on Android and iOS, so you can keep using it offline after downloading a model.

LLM X is a browser chat interface for people running models on their own hardware. It brings multiple model servers into one place and lets you compare their responses within a conversation.

LiteRT-LM is Google's open-source framework for developers building apps that run language models on the user's device. It uses LiteRT for local inference across mobile devices, desktops and browsers, with GPU and NPU acceleration. The project uses the Apache 2.0 license.

Transcribro lets Android users dictate text with speech recognition running on their device. It supports English only and can also provide transcription to compatible apps.

Offeline is a local AI chat app for people who want to talk to AI on their phone or tablet without sending conversations to a hosted chatbot. It processes chats on the device.

Moonshine is an on-device AI toolkit for developers building voice agents and spoken interfaces. Voice processing runs on the device without an account or API keys.

Off Grid AI is a local AI app for people who want chat, document analysis and media tools on their own phone or computer. Downloaded models work offline, and the core app doesn't require an account.

Moshi is a voice AI model and dialogue framework for researchers and developers building spoken applications. It processes speech directly and can listen while it speaks, including information such as emotion and non-verbal cues.

SmolVLM is a compact vision language model for developers building applications that interpret images and answer questions about them. It can run on-device, including on laptops and smaller local setups.

Bergamot Translator is a local AI translation library for developers building translation into browser or native applications. People who want to translate web content can use it through the separate TranslateLocally extension for Firefox.

Parakeety is a paid Mac dictation app for people who want to speak into the app they're already using without sending their voice to a cloud service. It runs on Apple Silicon Macs with macOS 14 or later and places the transcript at the cursor. Intel Macs aren't supported.

RKLLM is a toolkit for developers building local AI applications on Rockchip boards. It runs language and multimodal models on the chip's neural processing unit (NPU).

Airux Pocket AI runs AI conversations on Android phones for people who want offline chat and photo analysis without cloud inference. You don't need an account, and downloaded models run directly on your phone.

NeuTTS is a collection of on-device text-to-speech models for developers building voice assistants and speech-enabled apps. It generates audio on your own hardware rather than sending speech generation to a cloud API.

Atomic Chat is a local LLM app for people who want to chat with models on their own device or use them with coding assistants and AI agents. It began as a fork of Jan by Menlo Research.

OfflineLLM is an on-device AI chat app for Android users who want to run models locally without sending conversations to a cloud service. It works fully offline and has no network permissions.

Jan is a desktop AI chat app for people who want to run models on their own computer while retaining the option to use cloud providers. Local model use works offline; choosing a hosted model sends requests to that provider.

Willow is a voice assistant for people who want to control home automation through hardware and speech processing they own. It provides an alternative to Amazon Echo or Google Home on Espressif's ESP32-S3-BOX hardware family.

Slotstream runs Qwen3.8-Flash-Next on Apple Silicon Macs with too little RAM to hold the whole model. It's aimed at Macs with 16 to 64 GB of memory, for people who want local chat, answers about pictures or a backend for coding assistants.

LiteRT is Google's framework for developers adding machine learning and generative AI to apps that run on users' devices. It succeeds TensorFlow Lite and supports local inference without a server round trip.

Fluid is a local AI assistant for Mac users who want to ask questions without sending their chats to a hosted model. It runs Meta Llama 3 on your Mac and supports offline conversations.

Needle is an AI model for developers building device assistants that turn requests into actions. It prioritizes automation over general chat, with smaller model variants for devices that have limited resources.

Fullmoon is a local LLM chat app for people who want conversations to stay on their Apple devices. It runs models on-device and works fully offline, with chat history saved locally.

ReScript is a video and audio editor for people cutting interviews, podcasts and voice notes through text. Deleting words from a transcript removes the matching sections of the recording.

Draw Things creates and edits images on iPhone, iPad and Mac. It's for artists and other creators who want to work offline and keep generation on their own hardware.

SmolChat is an Android app for chatting with language models on your phone. It gives people who want on-device AI a chat interface for their own GGUF model files, including small language models.

Open Wispr is a voice dictation tool for people who want to speak into Mac apps while keeping audio and text on their computer. It inserts transcribed speech at the cursor in editors, browsers, terminals, email and other applications.

OpenSuperWhisper is a speech-to-text app for people who want to dictate or transcribe saved recordings on an Apple Silicon Mac. It runs Whisper and Parakeet models locally.

Enclave AI is a local AI assistant for people who want to chat, work with documents or use voice conversations on their Apple devices. Downloaded models handle these tasks offline.

picoLLM is an on-device LLM inference SDK for developers adding text generation to their apps. Inference works offline, but a Picovoice account and AccessKey are required, and key validation needs an internet connection.

Meetily records calls and turns them into live transcripts and meeting summaries. It's for people who want to keep meeting recordings on their own computer without adding a recording bot to the call.