Tools tagged with "MLX"

MindMac is a native macOS AI chat client for people who want local models and cloud providers in one app. Its inline mode lets you get writing help inside Notes, Mail and browsers without switching to a separate chat window.

MLX Omni Server lets developers use local models through both OpenAI-compatible and Anthropic-compatible APIs on an Apple Silicon Mac. It's for applications built around those SDKs that need inference on hardware the developer controls. Apple's MLX framework provides hardware acceleration, and all AI processing stays on the Mac.

CoWork OS is an AI agent desktop for developers and people working with documents, research and email. It brings tasks and their outputs into one workspace, where you can review agent actions and control approvals.

Harbor helps people experiment with local LLMs by connecting model backends, chat interfaces and supporting services. Its CLI and companion app manage those connections in a shared development environment.

Pico MLX Server is a macOS app for people who want to run MLX models locally and use them with an existing AI chat client. It gives MLX Server a graphical interface and exposes local models through an OpenAI-compatible API. The project is open source under the MIT license and requires macOS Sonoma or later.

TranscriptionSuite is a speech-to-text app for people recording lectures, transcribing conversations or dictating documents on their own hardware. Transcription works offline after the app and model downloads, keeping audio and transcripts local.

LocalAI is a self-hosted AI runtime for developers and teams that want to run models on their own hardware. It brings language, speech, vision and media generation into one server that existing AI applications can connect to.

MinerU is a local document parser for people preparing files for AI workflows. It handles scanned PDFs, academic papers and other documents containing OCR text, tables, figures or complex layouts.

Moshi is a voice AI model and dialogue framework for researchers and developers building spoken applications. It processes speech directly and can listen while it speaks, including information such as emotion and non-verbal cues.

GPTQModel is a Python toolkit for developers compressing LLMs and running them on their own hardware or servers. It combines model preparation, quality evaluation and inference so you can assess compression choices within one workflow.

MFLUX is a Python toolkit for creators and developers who want to generate and edit images on an Apple Silicon Mac. It provides a command-line interface for working with models locally.

Excel AI Assistant is an MIT-licensed add-in for people who want AI to make changes directly in their spreadsheets. It runs on your machine alongside Excel for Mac, Windows or the web, and uses plain-language requests to edit the open workbook.

Unsloth is a desktop app for people who want to chat with models, train them on their own data, and create media on their own hardware. Its no-code interface brings these tasks into one workspace.

Atomic Chat is a local LLM app for people who want to chat with models on their own device or use them with coding assistants and AI agents. It began as a fork of Jan by Menlo Research.

LLMKube manages self-hosted LLM inference for teams and homelab owners who need several machines to serve models together. It brings Linux GPU servers and Apple Silicon Macs into the same Kubernetes-managed fleet.

MLX VLM is a Python package for developers and researchers who want to run multimodal models on their own Mac. It supports local inference and fine-tuning through MLX.

Falcon-H1 is a family of language models from the Technology Innovation Institute for developers building AI applications on their own hardware. Smaller models suit edge devices, while larger variants target server deployments.

MLX Audio is a Python library for developers building speech and audio applications on Apple Silicon Macs. It runs models locally using Apple's MLX framework, with support for generated speech, transcription and audio processing.

Slotstream runs Qwen3.8-Flash-Next on Apple Silicon Macs with too little RAM to hold the whole model. It's aimed at Macs with 16 to 64 GB of memory, for people who want local chat, answers about pictures or a backend for coding assistants.

Nativ is a macOS app for people who want AI chat and coding tools to use models running on their own Mac. It combines a chat workspace, model library, and local inference server.

VideoLingo is a video translation app for creators and educators producing bilingual subtitles or dubbed videos. Its self-hosted browser interface brings transcription, translation and subtitle preparation into one workflow, though the selected providers determine which processing stays local.

exo is a local LLM runner for people who want to run models too large for a single machine's memory. It joins devices into a cluster and runs inference on your own hardware.

Msty is a family of AI products for individuals, teams and organizations working with models and their own knowledge. Msty Studio is its workspace product, with separate products for agents and centralized model access.

Fullmoon is a local LLM chat app for people who want conversations to stay on their Apple devices. It runs models on-device and works fully offline, with chat history saved locally.

npcpy is a Python library for developers and researchers building AI agents and applications with language models. It supports local LLM backends as well as cloud providers, so projects can choose where model requests run.

Transcribe Anything turns recordings and online videos into text and subtitles using Whisper-based speech recognition. It's a command-line tool with a Python API for people processing media locally or adding transcription to their own applications.

Moltis is a personal AI agent server for people who want an assistant that remembers earlier conversations and carries out tasks on their own hardware. You can reach the same agent through a browser or messaging apps.

WebOperator is an AI browser agent for automating tasks in the Chrome tabs you already use. It retains your existing logins and sessions, and can use a local model or a remote provider.

Claude Code Local lets developers use Claude Code with a model running on their own computer. It suits people who want to keep coding offline or continue working when they hit cloud usage limits.

Eclaire is a self-hosted AI assistant for people who want to ask questions about their saved information and act on it in one place. It brings documents, notes, photos, bookmarks and tasks into a shared library.

MLX Tune is a Python library for adapting AI models on an Apple Silicon Mac. Formerly unsloth-mlx, it is an independent project and is not affiliated with Unsloth. Its Unsloth-compatible API lets you prototype training locally with minimal changes to existing scripts, then move to NVIDIA hardware with Unsloth. Training runs through Apple's MLX framework and doesn't require a cloud GPU.

Jina Embeddings is a family of models for developers building semantic search, retrieval-augmented generation (RAG) and AI agent applications. The models convert content into vectors that a search system can compare for relevance.

Klee is a native macOS AI chat app and agent for people who want an assistant to work with files on their Mac. It runs models locally through MLX, and downloaded models can chat offline without an account or API key.

MLX LM is a Python package for developers and researchers who want to generate text and adapt language models on Apple Silicon Macs. It uses MLX for local inference and training, with access through Python or a terminal.