Open Music and Sound Generation Models
Models that generate music, sound effects or a soundtrack for a video, including ACE-Step, YuE and Stable Audio Open.
Local AI music separation software splits songs into vocals, drums, bass and accompaniment on Windows, macOS and Linux, with CPU or CUDA GPU processing.
3.5KUpdated 3 weeks agoMIT
macOS · Windows · Linux · Docker#Batch processing#Quantization
Demucs separates mixed music recordings into parts for musicians who want to work with individual instruments or vocals. The author maintains a separate repository, with no active feature development and slow responses expected.
Music and Sound ModelsStem Separation and Audio Cleanup+0
A local text-to-audio model generates multilingual speech, music and sound effects on CPU or CUDA GPUs, with MIT-licensed commercial use.
39.4KUpdated 3 years agoMIT
#Hugging Face integration#Multilingual
Bark is Suno's text-to-audio model for developers and researchers experimenting with speech and other sounds. It can depart from the supplied script, which matters if you need an exact spoken reading.
Music and Sound ModelsText-to-Speech and AudiobooksText-to-Speech Models+0
An open-source AI music generator that turns lyrics into songs with editable scores and runs locally on Linux with an NVIDIA GPU.
13.5KUpdated 2 weeks agoApache-2.0
Linux · Web#Hugging Face integration#Multilingual#Multimodal input
YuE is an AI music generation project for songwriters, musicians and developers who want to create songs with vocals and accompaniment. Its YuE2 models produce an editable composition before rendering the audio, giving you control over the music behind the recording.
Music and Sound ModelsMusic Generation+0
AudioLDM 2
1 videoA local AI audio generator for sound effects, music and speech, with CPU, NVIDIA CUDA and Apple Silicon support plus Hugging Face Diffusers integration.
2.6KUpdated 2 years ago
macOS · Linux · Web#Batch processing#Hugging Face integration
AudioLDM 2 is a local AI audio generator for sound designers and researchers experimenting with synthetic sound. It uses pretrained models to produce audio from text and provides a Gradio browser interface alongside command-line access.
Music and Sound ModelsMusic GenerationText-to-Speech and AudiobooksText-to-Speech Models+0
A local AI music analysis model transcribes lyrics with timestamps, describes songs, and answers questions about full tracks through SGLang or Transformers.
221Updated 6 months ago
Web#Hugging Face integration#Multilingual#Multimodal input
MOSS-Music is a local AI model for people who need to describe, transcribe, or analyze recorded music. It works with full tracks and combines sung lyrics with musical details in its responses.
Music and Sound ModelsSpeech-to-Text and TranscriptionSpeech-to-Text Models+0
An open-source text-to-speech model for multilingual narration and voice cloning, with pronunciation and timing controls, licensed under Apache 2.0.
4.3KUpdated 2 months agoApache-2.0
Web#Multilingual#Multimodal input#Streaming inference
MOSS TTS generates speech for developers and creators working on narration, dubbing and other long audio content. It supports consistent voices across long passages and can clone a speaker from reference audio without separate training for that voice.
Music and Sound ModelsOn-Device and In-Browser AIText-to-Speech and AudiobooksText-to-Speech ModelsVoice Cloning and Voice Changers+0
An open-source AI music model generates songs and instrumentals locally on NVIDIA GPUs or Apple Silicon, with lyric editing and track variations.
5.1KUpdated 9 months agoApache-2.0
macOS#LoRA#Multilingual
ACE-Step is a local AI music model for musicians and producers who want to generate songs or revise existing audio. It accepts text descriptions and lyrics, with control over the length of the result.
Music and Sound ModelsMusic Generation+0
A local text-to-audio model generates sound effects and music samples on CPU or CUDA GPUs, with support for Diffusers and stable-audio-tools.
3.9KUpdated 6 months agoMIT
#Batch processing#Hugging Face integration
Stable Audio Open generates audio from text for artists and researchers experimenting with sound effects, field recordings and music samples. It performs better on effects and environmental sounds than music, and it can't generate realistic vocals.
Music and Sound Models+0
A multimodal AI model family that understands text, images, video and audio, with an Omni model that generates text, images and speech.
1.1KUpdated 3 months ago
#Image-to-image#LoRA#Multimodal input
Uni MoE is a family of multimodal AI models for researchers working with language, visual material and audio together. Its Omni model can reason across combined inputs and answer questions about their content.
Image Generation ModelsMusic and Sound ModelsSpeech-to-Text ModelsText-to-Speech ModelsVision-Language Models+0
A text-to-music model in the MIT-licensed AudioCraft library, with melody guidance and code for generating music and training models.
23.9KUpdated 2 years agoMIT
#Multimodal input
MusicGen is Meta AI's model for generating music from written descriptions. It's part of AudioCraft, a PyTorch library for developers and audio researchers building music generation tools in their own computing environment.
Inference Libraries and BindingsMusic and Sound ModelsMusic GenerationTraining Frameworks+0
A local AI music generator that creates full-length songs with diffusion, supports Windows, Linux and Docker, and has Apache 2.0 licensing.
2.4KUpdated 12 months agoApache-2.0
macOS · Windows · Linux · Docker#Hugging Face integration#Multimodal input
DiffRhythm is an AI music generation model for musicians and developers who want to create full-length songs on their own hardware. It uses diffusion to generate songs from lyric and reference-audio inputs.
Music and Sound ModelsMusic Generation+0
A local AI music model and synthesis engine for Apple Silicon, with a standalone macOS app and an AUv3 plugin for digital audio workstations.
1.9KUpdated 4 months agoApache-2.0
macOS#MLX#Streaming inference
Magenta RealTime is a local AI music model and synthesis engine for musicians playing AI instruments and developers building interactive music apps. It generates a continuous audio stream on supported Apple Silicon Macs.
Inference Libraries and BindingsMusic and Sound ModelsMusic Generation+0
LogotyperGot an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
