Magenta RealTime

Magenta RealTime is a local AI music model and synthesis engine for musicians playing AI instruments and developers building interactive music apps. It generates a continuous audio stream on supported Apple Silicon Macs.

• Live music generation: Choose a smaller model that runs in real time on any Apple Silicon Mac, including MacBook Air, or a larger model for higher quality on supported hardware.
• App and DAW use: Play through a standalone macOS app or an AUv3 plugin for digital audio workstations.
• Musical controls: Explore note control and prompts through example apps built around the model.
• Custom instruments: Embed music generation in your own software with the Python library's JAX and MLX backends or the C++ streaming engine for Apple Silicon.

Real-time streaming requires Apple Silicon. Supported hardware for the larger model includes M2 Max, M3 Max, M5 Max and M4 Pro. Both models can also generate audio without real-time playback on any Apple Silicon Mac or an NVIDIA GPU through the Python library.

The model runs on your hardware and has open weights. The project's open source code uses the Apache 2.0 license.