Run AI Models in the Browser and on Phones

Kai 9000 is a personal AI assistant for people who want remembered context and tools that can act on their requests. Its responses can include interactive screens such as quizzes, recipe cards and dashboards.

ExecuTorch is an on-device AI runtime for developers adding PyTorch models to apps and embedded devices. It handles inference on the user's hardware across Android, iOS, macOS, Linux and Windows, as well as embedded systems and microcontrollers.

Notely Voice turns speech and recordings into editable notes for lectures, meetings and interviews. It runs Whisper on your device, so speech recognition works offline after you download a model and doesn't upload audio to a cloud service.

TensorRT is NVIDIA's inference toolkit for developers deploying AI applications on NVIDIA GPUs. Its compilers, runtimes and model optimizations target lower response latency and higher throughput on local machines, self-hosted servers and edge devices.

Wordflow is an AI writing assistant for writers and researchers who want to reuse editing prompts across their work. Its browser editor lets you revise a paragraph or selected passage with a choice of local and external models.

Tellama is a local LLM chat app for Android users who want conversations to stay on their phone. Chat with an installed compatible model works offline, and you don't need an account.

Optimum is a collection of Python packages for developers adapting Hugging Face models to their deployment hardware. It extends Transformers, Diffusers, TIMM and Sentence Transformers with tools for faster inference and training.

OpenVINO is an AI inference toolkit for developers deploying models in their own applications. It converts and optimizes models for local hardware or servers, covering generative AI and conventional machine-learning workloads.

MNN is a C++ framework for developers running AI models on phones, PCs and embedded devices. It supports inference and training on the device, with a small application footprint and hardware acceleration.

wllama lets developers add local LLM inference to browser apps without a separate inference server. It brings llama.cpp to JavaScript and TypeScript projects through WebAssembly, so models run on the user's device.

Sidekick is a native macOS app for people who want AI answers grounded in their documents and research materials. Its built-in llama.cpp engine runs GGUF models such as Qwen3.5 without a separate model runner.

whisper.cpp runs OpenAI's Whisper speech recognition models on your own hardware. It's for developers adding transcription to applications and people who need offline speech-to-text.

PocketPal AI runs language models on phones and tablets for people who want an assistant they can use without sending conversations to a server. Core chat works offline after a model download and doesn't require an account.

Silero VAD is a pretrained voice activity detection model for developers who need to find speech segments in audio. It returns speech timestamps for use in audio processing pipelines.

LLM Farm is an app for on-device AI conversations and comparing language models on Apple hardware. It suits people who want offline chat or need to assess which model fits a project.

Priv AI is an on-device assistant for people who want to chat with AI and use it to examine personal health and financial information. It works offline after a model download and doesn't require an app account.

unbagrnd removes image backgrounds locally for people who need cutouts without uploading pictures to a cloud service. It includes an app for individual images and folders, plus a self-hosted API for developers.

Sokuji translates speech for people taking part in meetings across languages. Other participants hear your translated voice as ordinary call audio, so they don't need to install anything.

VoxKey is a free, open-source dictation app for people who want to speak into Mac text fields without sending audio to a cloud transcription service. It requires Apple Silicon and macOS 26 or later. Speech recognition runs locally and works offline after you download a model.

Argmax OSS Swift is a speech AI SDK for developers building iOS and macOS apps that process audio on the user's device. Its separate libraries cover transcription, identifying speakers and generating spoken audio.

ChatterUI is an Android chat app for people who want to use a local LLM on their phone or connect to a remote model. It supports assistant and character conversations, with control over reply generation and chat formatting.

Locally AI is a native assistant for people who want to use language and vision models on their own Apple devices. It handles text, images and spoken conversations without sending AI processing to a cloud service.

WebLLM is an engine for developers building browser-based AI assistants and Chrome extensions. It runs language models on the user's device, so applications don't need a separate inference server to process prompts.

Google AI Edge Eloquent turns speech into edited text for people who prefer dictating notes and drafts to typing them. It uses on-device Gemma models to remove verbal filler and self-corrections.

Aiko turns recorded meetings, lectures and voice memos into text for people who want to keep their audio on their own device. It processes completed recordings rather than live speech and doesn't identify individual speakers.

Transformers.js is a JavaScript library for developers adding on-device AI to web apps. It runs models in the browser, so processing inputs doesn't require a separate inference server.

WebBrain is an AI browser agent for people who want to ask questions about pages or delegate web tasks from a sidebar. It works in your existing browser, including signed-in tabs, and starts in read-only Ask mode.

Stable Diffusion Core ML is a developer toolkit for adding local AI image generation to Mac, iPhone, and iPad apps. It pairs model conversion tools with a Swift package for embedding generation in native software.

Whisperian is an Android speech-to-text app for people who'd rather dictate than type, including writers, engineers and people handling everyday correspondence. It supports offline transcription as well as cloud services, and gives users configurable workflows as an alternative to WisprFlow or Superwhisper.

Cloak by Polyaura is an on-device AI app for people who want to chat and work with voice recordings on their iPhone or iPad without sending them to a cloud service. It works without an internet connection after the initial model download.

Google AI Edge Gallery is a local AI app for people who want to use and compare generative models on their own devices. Model inference runs on-device, including offline chat and media tasks.

MediaPipe is a toolkit for developers adding on-device AI to applications. It provides pretrained models and task APIs for applications that need to process images, video, text or audio on the user's device.

Osaurus runs AI agents on your Mac for tasks such as reviewing documents, organizing files, and writing code. It keeps agent memory on your computer, so you can change models without losing the context of your work.

ONNX Runtime is an AI inference and training engine for developers adding models to apps and services. It supports deployment on a user's device or a server, including applications that need the same model format across platforms.