Local AI Music Generators

Pallaidium is a Blender add-on for filmmakers and AI artists who want to develop scenes with generated visuals and sound before shooting. It puts generation on the Video Sequence Editor timeline, where you can test dialogue timing and edit scenes alongside music.

Lollms WebUI is a local AI interface for writing, coding assistance and media generation through a choice of models. The project receives minimal maintenance, and its interface has no built-in user authentication.

Guaardvark is a local AI studio for people who want document chat, task automation and media production on their own hardware. It brings those jobs into one interface and coordinates their use of the GPU.

audio.cpp runs audio models locally for developers building speech tools and people generating or processing audio on their own hardware. It brings multiple audio tasks into one C++ runtime built on ggml.

YuE is an AI music generation project for songwriters, musicians and developers who want to create songs with vocals and accompaniment. Its YuE2 models produce an editable composition before rendering the audio, giving you control over the music behind the recording.

Visions of Chaos combines generative AI tools with fractals and complex-system simulations in one application. It's for digital artists, educators and people who want to explore machine learning or mathematical patterns without working through the equations themselves. Its AI models run privately on your own hardware, without paid online APIs or backend usage logging and telemetry.

Amphion is an audio generation toolkit for researchers and engineers developing speech and singing systems. It brings model implementations, dataset preparation and evaluation into one research codebase.

AudioLDM 2 is a local AI audio generator for sound designers and researchers experimenting with synthetic sound. It uses pretrained models to produce audio from text and provides a Gradio browser interface alongside command-line access.

TTS WebUI is a self-hosted browser interface for people creating speech and music or processing audio with AI models. It brings these tasks into one place, with model choices for different kinds of audio work.

Phosphene is a generative media studio for people creating videos on their own Mac. It combines video, still images, music and character training in one interface, with generation running on-device.

ACE-Step Studio is a desktop AI music generator for musicians and anyone who wants to create songs on their own hardware. It turns a short idea, or a description with lyrics, into a full vocal track or instrumental.

SwarmUI is a self-hosted AI image generation interface for people who want both straightforward generation controls and access to detailed ComfyUI workflows. You can use it with models running on your own hardware.

biniou brings AI chat and media creation into one browser interface on your own computer or server. It's for people who want to work with several kinds of generative AI without switching between separate apps.

ACE-Step is a local AI music model for musicians and producers who want to generate songs or revise existing audio. It accepts text descriptions and lyrics, with control over the length of the result.

Fish Diffusion is a Python framework for developers and researchers training diffusion models for text-to-speech, singing voice synthesis and singing voice conversion. It works with your own datasets and provides code you can adapt for different voice generation tasks.

DiffSynth-Studio is a diffusion model engine for developers and researchers generating media or training models on their own hardware. It combines inference and training, with memory-saving features for consumer GPUs.

DiffSinger generates synthetic singing voices for voice developers and music production. OpenVPI maintains this fork of MoonInTheRiver/DiffSinger, with acoustic models and adjustable vocal expression controls.

MusicGen is Meta AI's model for generating music from written descriptions. It's part of AudioCraft, a PyTorch library for developers and audio researchers building music generation tools in their own computing environment.

DiffRhythm is an AI music generation model for musicians and developers who want to create full-length songs on their own hardware. It uses diffusion to generate songs from lyric and reference-audio inputs.

Wan2GP generates media on your own computer for creators who want to work with several AI models in one browser interface. It builds on Wan-Video/Wan2.1 and focuses on making generation accessible on GPUs with limited memory.

Magenta RealTime is a local AI music model and synthesis engine for musicians playing AI instruments and developers building interactive music apps. It generates a continuous audio stream on supported Apple Silicon Macs.