NVIDIA Nemotron 3 Nano Omni: sub-agents with Turnstone

Learn how developers use Nano Omni for voice and video in agent workflows, with a Turnstone demo and reported RTX 3090 and laptop 4060 experiences.

Player not loading? Watch on YouTube

NVIDIA's discussion examines Nemotron 3 Nano Omni as a perception model within a larger AI agent workflow. The host describes a model with 30 billion total parameters and 3 billion active parameters that accepts video, images, audio and text, then returns text. The panel recommends giving it a narrow task rather than making it the main orchestrator.

Wendell Wilson demonstrates an Omni integration in his fork of Turnstone. Voice input passes through Omni to MiniMax 2.5, while another example uses Omni to interpret graphs from Wi-Fi testing scripts. Turnstone combines work streams with a judge model, approval policies and algorithmic rules. Wilson says these controls improve predictability; he does not claim they guarantee deterministic behavior. His integration was awaiting a merge into the main project.

Corey Noles describes an unfinished desktop app for searching podcast archives. His proposed pipeline uses Omni for transcripts and timestamped chunks, Mercury 2 for checks, and a separate embedding model for semantic retrieval.

For viewers planning a local LLM setup, Wilson reports use on RTX 3090 hardware, while Noles says a laptop 4060 runs the model more slowly. These are personal reports rather than minimum requirements. Both discuss tool-calling weaknesses. Wilson found that another model handling organization, with Omni returning focused JSON results, worked better.