Magenta RealTime
An open-source AI music model and synthesis engine that runs locally on Apple Silicon, with a macOS app and AUv3 plugin for DAWs. Apache 2.0 licensed.
Magenta RealTime 2 is a local AI music model and synthesis engine for musicians and developers who want to play or build AI musical instruments on a laptop. It generates streaming audio in real time, with open weights and code under the Apache 2.0 license.
You can use it through a standalone macOS app or an AUv3 plugin for DAWs. Example apps explore note control and musical prompts, giving developers concrete starting points for instruments and interactive music software. The model runs on your own hardware.
Real-time playback requires Apple Silicon. The smaller model runs on any Apple Silicon Mac, including MacBook Air models. The larger model offers higher quality but needs more powerful supported Apple Silicon hardware to generate audio faster than playback. Both models also support generation without real-time playback on any Apple Silicon Mac or an NVIDIA GPU through the Python library.
For developers, the project includes a Python library with JAX and MLX backends and a C++ engine for streaming audio on Apple Silicon MacBooks. These support embedding music generation into custom applications or building a DAW plugin around the model. The repository includes standalone app and plugin examples alongside the inference libraries.
The original Magenta RealTime model and code remain on the v1_legacy branch.
