Tools tagged with "MLX"

llmfit helps people choosing models for their own computers compare what will fit in memory and how fast it might run. It checks your hardware before recommending models, so you can assess candidates before downloading them.

ExecuTorch is an on-device AI runtime for developers adding PyTorch models to apps and embedded devices. It handles inference on the user's hardware across Android, iOS, macOS, Linux and Windows, as well as embedded systems and microcontrollers.

Kubeflow is a self-hosted AI platform for teams developing and running machine learning workloads on Kubernetes. Its modular projects cover interactive development, training and the work of moving models into production.

vLLM Metal lets developers serve language models on Apple Silicon Macs through vLLM. It's for people who want to use their Mac's hardware for local AI inference while keeping vLLM's API server and request scheduling.

AudioWhisper is a macOS menu bar app for dictating into other apps and converting recordings to text. It suits people who want on-device speech recognition with the option to use cloud transcription.

Vyact is a desktop workspace for people who want a local LLM to help with files, writing and code. It brings conversations and searchable documents together, with optional connections to email services and Chrome.

llmserve is a terminal app for people who keep local LLM models across several folders or inference tools. It brings model discovery and server management into one interface so you can choose an existing model and an available backend.

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

Libre WebUI is a self-hosted AI workspace for individuals and teams who want chat, document research and AI agent tasks on infrastructure they control. You can use local models or connect a remote provider of your choice.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

WhisprStream turns speech into text at your cursor in other Mac apps. It's for people who dictate notes, email, or coding prompts and want speech processing to stay on their own computer.

Terax brings a terminal, code editor and AI coding agents into one desktop workspace. It's for developers who want to work with agents alongside their shell, files and running app.

Transcritório is a desktop app for researchers transcribing interviews and focus groups, with a focus on Brazilian Portuguese. It keeps audio, transcripts and metadata on your computer.

Marbor is a self-hosted AI inference gateway for operators serving models across their own GPU fleet. It places requests using live hardware and model state to reduce cold loads and avoid deployments that can't serve the requested model.

Locally AI is a native assistant for people who want to use language and vision models on their own Apple devices. It handles text, images and spoken conversations without sending AI processing to a cloud service.

TypeWhisper is a macOS dictation and transcription app for people who want to turn speech into text across their apps. Local speech models keep audio on your Mac; optional cloud transcription sends it to the selected provider.

Second Me is an open-source prototype for people who want to train and host an AI representation of themselves. It uses personal memories to shape a model around their identity and context.

TensorSharp runs local AI models for .NET developers and people who want chat, media generation and agent tools on their own hardware. You can embed it in a C# application or use its CLI, browser interface or companion app, TensorAgent.

Deep Research is a self-hosted AI agent for people who want web research with traceable evidence and a library they control. It runs in Docker on your own machine or server, searches the web in successive rounds, and uses gaps in its findings to decide what to investigate next. Reports include citations, per-source notes with quoted evidence, and suggested follow-ups.

RamaLama runs AI models for local chat or a self-hosted REST API. It's for developers who want a container workflow for trying models on their own hardware and serving them in production.

Enconvo is a native Mac AI assistant for people who want help with writing, research and tasks inside their everyday apps. It uses screen and selected-text context so you can ask about what you're working on without moving everything into a separate chat.

vllm-mlx is a local LLM inference server for developers who want to connect AI apps and coding assistants to models running on an Apple Silicon Mac. One process exposes both OpenAI-compatible and Anthropic-compatible APIs. It's open source under Apache 2.0 and runs on macOS with at least 8 GB of unified memory.

Osaurus runs AI agents on your Mac for tasks such as reviewing documents, organizing files, and writing code. It keeps agent memory on your computer, so you can change models without losing the context of your work.

MiniCPM is a family of compact language models for developers building local assistants and coding agents. It targets on-device workloads and hardware with limited computing resources.

LEANN is a local vector database for people building AI search over personal data or knowledge collections. It reduces index storage by computing embeddings on demand rather than keeping every embedding on disk.

Noema is a local AI assistant for people who want to chat with models and get answers from their files on Apple devices. It brings models, documents and tools into a native workspace on iPhone, iPad, Mac and Vision Pro.

Pocket AI Lab runs AI models on an iPhone and helps you judge which ones the phone can handle. It's for people who want private chat on their device and want to check memory and storage before downloading model weights.

Phosphene is a generative media studio for people creating videos on their own Mac. It combines video, still images, music and character training in one interface, with generation running on-device.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

Voicebox combines speech creation and dictation for people producing audio or working with AI agents. It's a free, open-source alternative to ElevenLabs and WisprFlow that processes voice data on your own machine.

Flower is a federated AI framework for developers and researchers who want to train models across separate organizations or devices. Participants retain control of their data rather than gathering everyone's data in one place.

Soup is a local LLM fine-tuning tool for developers and teams adapting models to their own datasets. It brings training, evaluation and export into one workflow that runs on your own hardware without requiring a cloud service.

Sandbook is an offline text-to-speech reader for iPhone and iPad, for people who want to listen to books and documents without uploading them. It runs Kokoro-82M on the device through Apple MLX, with the speech model and voices included in the app. It needs no account and has no ads or tracking.

WhisperLiveKit is a self-hosted speech-to-text server for meeting transcripts, live captions and apps that need speech recognition as people talk. It processes audio on your own machine or server.