YuE

YuE is an open-source music generation project for musicians, songwriters and developers who want to turn lyrics and a style prompt into songs with vocals and accompaniment. Its YuE2 models create an editable melody and chord score before generating the recording, so you can review the composition and change musical details before hearing the result.

That score gives you control over melody, harmony, tempo and song structure. An AI agent can help revise the composition through conversation, including changes to lyrics and arrangement. Each edit generates a complete recording; it doesn't retain the original audio outside the edited passage.

For covers, SheetSage2 transcribes a source recording into a melody score that YuE2 can reinterpret with a different style or new lyrics. The project also includes an agent skill for generating instrumental music and working with song scores. The original YuE models support English, Mandarin, Cantonese, Japanese and Korean, including lyrics that switch languages within a song.

Local generation runs on Linux and requires an NVIDIA GPU with BF16 support and 24 GB of VRAM. Model files download from Hugging Face on first use, and the local runtime generates stereo audio on your hardware. A hosted demo provides a separate way to try generation online. The repository uses the Apache 2.0 license, and preserves the original YuE code and documentation on a separate branch.