SoniTranslate

A local AI video dubbing app that translates videos with synchronized audio through a browser interface and runs on Linux with CPU or NVIDIA GPU support.

Alternative to:

SoniTranslate is an AI video dubbing app for people translating spoken videos into other languages. It can run locally, with a Gradio interface in the browser.

Synchronized dubbing: Translate a video and generate speech that follows the timing of its original audio.
Language support: Translate into languages including English, Japanese, Arabic, Ukrainian, and Simplified or Traditional Chinese. Some supported languages allow translation but not transcription.
Optional OpenAI services: Use OpenAI's API for translation, transcription, or speech generation; content handled by those options goes to OpenAI.

Local installation has been tested on Linux. The app can run in CPU mode or use an NVIDIA GPU. A Colab runtime and online demo offer alternatives to running it on your own machine. The code is open source under Apache 2.0.