YuE

YuE is an AI music generation project for songwriters, musicians and developers who want to create songs with vocals and accompaniment. Its YuE2 models produce an editable composition before rendering the audio, giving you control over the music behind the recording.

• Lyrics to songs: Supply lyrics and a style prompt to generate a melody-and-chord score and a complete song.
• Composition editing: Inspect and change melody, harmony, tempo and song structure before generating another recording, with an AI agent able to help revise scores, arrangements and lyrics through conversation.
• Covers: Use SheetSage2 to transcribe a recording into a melody score, then generate an interpretation with a different style or new lyrics.
• Instrumental music: The included yue2-music agent skill supports instrumental generation as well as song creation and score editing.

Editing produces a new recording of the entire song. It doesn't preserve the original audio outside the passage you change.

Local generation runs on Linux and requires an NVIDIA GPU with BF16 support and 24 GB of VRAM. Model files download from Hugging Face on first use; the local runtime generates stereo audio on your hardware. A separate hosted demo lets you try generation online.

The repository uses Apache 2.0. The original YuE code and documentation remain available on the YuE-v1 branch.