Local AI for Speech, Voice and Music

YouDub-webui is a self-hosted video translation and dubbing app for creators and small teams making videos available in another language. Its most established workflow is English-to-Chinese dubbing for YouTube; it also supports Chinese-to-English dubbing for Bilibili.

Whispering Tiger creates live transcripts and translations from audio on your computer for VRChat conversations and streaming captions. It can also read text in game images, so spoken dialogue and visible text can feed into the same translation workflow.

Bolna builds voice AI agents for businesses handling support, sales and recruitment calls. It focuses on Indian languages and accents, including Hindi, Hinglish, Tamil and Telugu, alongside English.

Vexa is a meeting bot and transcription API for developers adding meeting features to products and teams connecting calls to AI agents. Its bots join Google Meet, Microsoft Teams and Zoom to capture the conversation.

Parakeety is a paid Mac dictation app for people who want to speak into the app they're already using without sending their voice to a cloud service. It runs on Apple Silicon Macs with macOS 14 or later and places the transcript at the cursor. Intel Macs aren't supported.

Amical is an AI dictation app for people who want to write emails, messages and coding prompts by speaking. It adjusts the resulting text to the app you're using, reducing the editing needed after transcription.

WhisperJAV generates subtitles for Japanese adult videos on your own computer. It targets difficult audio with quiet dialogue, loud vocalisations and long stretches that can cause speech recognition models to invent or repeat words.

faster-whisper is an open source Python library for developers adding speech transcription to their software. It uses CTranslate2 to run OpenAI's Whisper models, with faster transcription and lower memory use than the original implementation in the project's benchmark comparisons.

Step-Audio 2 is an audio AI model family for developers building voice assistants and applications that interpret recordings. It can reason about what people say and how they say it, as well as sounds beyond speech.

OpenWhispr is a dictation and meeting transcription app for people who want to write by voice and keep searchable records of conversations. It lets you choose local processing or cloud providers.

iZotope Nectar is a proprietary collection of vocal processing plugins for producers, audio engineers, musicians, and creators working with singing or dialogue. Its Vocal Assistant recommends a starting point for a mix that you can adjust to suit the recording. The assistant sets EQ, reduces sibilance, and creates space for the voice within the mix.

Vibe is a desktop app for people who need transcripts or subtitles from recordings without uploading them to a transcription service. It handles audio and video locally, including interviews, meetings and material in different languages.

XTTS v2 generates speech from text on your own hardware, using a voice recording as a reference. It's for developers adding speech to applications and researchers adapting a speech model to their own data.

LocalScribe records online meetings and turns them into timestamped transcripts on your PC. It's for people who need private meeting records they can review and correct while retaining the original text and audio.

UGTLive translates text on your Windows screen for games, manga reading and language study. It places translations over the app you're viewing and requires an NVIDIA RTX 20, 30, 40 or 50 series GPU with at least 8 GB VRAM.

StyleTTS 2 is a text-to-speech model for developers and speech researchers who want to generate expressive speech on their own hardware. It can choose a speaking style from the text without a reference recording.

smart:deess is a proprietary AI audio plugin for producers, mixers and speech editors who need to control harsh consonants and plosives in voice recordings. It runs in a DAW on macOS or Windows and combines detection of individual speech sounds with spectral processing to adjust their tone as well as their level.

Home-LLM connects Home Assistant to language models for voice and chat control of smart devices. It's for Home Assistant users who want those requests handled on their own hardware.

AIRI is a self-hosted AI companion for people who want to talk with a virtual character and have it participate in games. Inspired by Neuro-sama, it supports real-time voice conversations and is in early development.

Dictus Desktop is a free, open source voice dictation app for macOS, Windows and Linux. It turns speech into text in the app you're typing in, with transcription handled entirely on your computer. It's for people who want to dictate messages, documents or emails without sending their recordings to a cloud service.

AIlice is an open source AI agent that runs on your own machine and handles tasks spanning research, software development and system administration. It's for people who want an assistant that can act on files, browse the web and execute code. Its Interactive Agents Call Tree architecture splits complex requests among agents created for the task, then combines their results.

Utter is a proprietary dictation app for macOS that transcribes speech with local Whisper models. It's for people who want to speak into everyday apps or coding tools while keeping their audio on their own computer. Transcription runs on your Mac, and no audio leaves the device.

ACE-Step is a local AI music model for musicians and producers who want to generate songs or revise existing audio. It accepts text descriptions and lyrics, with control over the length of the result.

iZotope Ozone is a proprietary audio mastering suite for musicians, producers, and audio engineers preparing finished mixes for distribution. It combines mastering modules in one place with an AI-powered Master Assistant that creates a preset tailored to your audio. You can adjust that starting point or build the mastering chain yourself.

HyperWhisper is a desktop speech-to-text app for Windows and Linux that keeps recordings on your computer. It's for people captioning videos, transcribing interviews or podcasts, or turning recordings into searchable text. The interface brings transcription, editing and subtitle export into one place.

SnapOtter is a self-hosted application for people and teams who need to edit or convert private files without uploading them to an online processing service. It combines media, document and local AI tools in a browser interface.

MMAudio generates sound for video footage and text prompts. It's for video creators adding audio to silent clips and researchers studying how generated sound matches on-screen action.

Utsuwa is an AI companion for people who want a virtual character that remembers their conversations. It combines a 3D avatar with voice chat and optional relationship progression inspired by dating sims.

NeuTTS is a collection of on-device text-to-speech models for developers building voice assistants and speech-enabled apps. It generates audio on your own hardware rather than sending speech generation to a cloud API.

Pydantic AI is a Python SDK for developers building agents into their applications. It uses Pydantic validation to give application code structured results and check the arguments agents pass to tools.

OpenEnsemble is a self-hosted AI assistant platform for people who want shared access on their own server, with a separate workspace for each user. Linux is the main installation target; macOS supports local development with different feature support. You can choose a single assistant or an ensemble of specialist agents using different models. It's open source under AGPL-3.0.

local-transcriber is a free, open-source app for turning audio and video recordings into text on your own computer. It's aimed at people handling private interviews, client calls or long talks who want transcription without uploading recordings to a cloud service. It runs fully offline once the required models are downloaded.

MLX Audio is a Python library for developers building speech and audio applications on Apple Silicon Macs. It runs models locally using Apple's MLX framework, with support for generated speech, transcription and audio processing.

WhisperBuddy is a native macOS app for people who need transcripts, subtitles, or voice dictation while keeping their recordings on their own computer. It transcribes audio and video files, listens to live input, and translates transcripts offline. Audio and text stay on your Mac.