Run AI Models in the Browser and on Phones

SemanticFinder helps readers and researchers find passages by meaning in long documents. It runs the search model in your browser, so you can search your own text without sending it to a model server.

Linguist is a browser translation extension for people reading, communicating or studying across languages. You can choose on-device translation or connect a translation service that suits your needs.

Candle is a Rust machine learning framework for developers embedding local AI in applications or deploying models on their own servers. It supports inference and training, including small CPU deployments for serverless applications.

Personal LLM runs AI chat on your phone for people who want to ask questions without sending them to a cloud model. Chat, photo analysis and document questions work offline after you download a model and any required image support files.

WhisperIME converts speech to text on Android for people who want offline dictation in their keyboard or a standalone transcription app. It uses Whisper for recognition on the device.

PrivateLM is an AI chat app for people who want to run models on their phone or tablet and choose when to use a cloud provider. It supports local inference on Android and iOS; the browser version requires cloud APIs.

Whats Reader lets you revisit exported WhatsApp conversations and their attachments without sending the files to a service. It works with individual and group chats, so you can review old conversations or find details buried in messages and voice notes.

Talk DAT! is a free, open-source dictation app for people who want to turn speech into formatted writing across their desktop apps. It runs on Windows 10 and 11 and Apple silicon Macs with macOS 14 or later. Downloaded models let it work offline without an account, keeping speech and text on your computer.

RTranslator helps people hold spoken conversations in different languages using their Android phones. It runs translation locally and works offline.

Chatterbox is a text-to-speech model family for developers and creators who want to generate voices on their own hardware. It suits narration, voice agents and interactive media, with models for English and multilingual speech.

RecurseChat is a Mac app for people who want private AI conversations and answers drawn from their own documents. Local models run without an internet connection or a separate server.

FastVLM is a family of local vision-language models for developers and researchers building applications that answer questions about images. It focuses on reducing the delay before an answer starts, especially with high-resolution images.

Dictate Keyboard is a voice keyboard for people who prefer speaking to typing in Android apps. It builds on FlorisBoard and lets you choose where speech recognition happens.

ChatLLM Web is a browser app for people who want AI help with text and code while keeping their working data on their device. It combines chat, model selection, and an agent that can work with files you choose.

Thuki is a floating AI assistant for Mac users who want help with the text or screen they're already viewing. It appears above other apps, including fullscreen windows, and automatically brings selected text into the conversation.

Noema is a local AI assistant for people who want to chat with models and get answers from their files on Apple devices. It brings models, documents and tools into a native workspace on iPhone, iPad, Mac and Vision Pro.

llama.rn is a library for developers adding local LLM features to React Native apps on iOS and Android. It brings llama.cpp inference onto the device, so an app can process model requests on the user's hardware.

Pooled runs a single open model across laptops, desktops and phones in browser tabs. It lets people combine their devices' memory to use a model that wouldn't fit on one device, for shared chat or coding tasks.

Offline Translator is an Android app for translating material when you don't have an internet connection or want translation to stay on your device. It handles everyday text as well as images and PDF/ODT documents.

CloverPal is an Android app for private AI conversations and character roleplay on your phone. It runs models on-device, so you can chat offline once you've downloaded or imported a model.

Private LLM runs AI chat on iPhone, iPad and Mac for people who want to use language models without sending conversations to a cloud service. It works offline after the first model download and doesn't require an account.

Pocket AI Lab runs AI models on an iPhone and helps you judge which ones the phone can handle. It's for people who want private chat on their device and want to check memory and storage before downloading model weights.

Cactus is an on-device AI engine for developers adding automation to mobile apps, wearables and other small devices. Its Needle model turns requests into tool calls locally, including when the device has no internet connection.

MiniCPM-V is a family of local vision-language models for developers building applications that interpret images and video. It can run on phones and other hardware you control.

ncnn is a C++ inference framework for developers adding on-device AI to mobile, desktop and embedded applications. It focuses on a small memory footprint and doesn't require third-party runtime dependencies.

Private Mind is a mobile AI assistant for people who want to chat and read documents without sending their content to a cloud service. It runs AI and document processing on your phone.

OlliteRT lets you use an Android phone as a private AI server for apps on your local network. It's for people who want to run models locally for chat clients or home automation without a cloud inference service.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

Riffado turns recordings from Plaud Note, Note Pro, and NotePin devices into searchable transcripts and summaries. It's for recorder owners who want control over AI processing and storage. Recording sync requires a Plaud account and access to Plaud's cloud, so the full workflow isn't offline.

Vocaldi is a paid Mac app that combines voice typing with read-aloud for people who prefer speaking to typing or listening to written text. Transcription, dictation cleanup and speech synthesis run on your Mac, so the audio and text you process stay on the device. It requires Apple Silicon and macOS 14 or later.

Radiant Camera is an iPhone camera and photo editor for people who want automatic scene adjustments with room to fine-tune the result. All image processing, including AI, runs on your device. It combines capture and editing in one app, with scene detection for portraits, pets, macro shots, night scenes, and landscapes.

Sandbook is an offline text-to-speech reader for iPhone and iPad, for people who want to listen to books and documents without uploading them. It runs Kokoro-82M on the device through Apple MLX, with the speech model and voices included in the app. It needs no account and has no ads or tracking.

NobodyWho Chat is an on-device AI assistant for people who want help with writing, brainstorming, coding and questions without sending their conversations to a hosted model. Language-model inference runs on the phone, and chat works offline without an account.

MOSS TTS generates speech for developers and creators working on narration, dubbing and other long audio content. It supports consistent voices across long passages and can clone a speaker from reference audio without separate training for that voice.