Nemotron 4 & NeMo Switchyard: Nvidia's Open-Model Router Play
Nvidia released Nemotron 3.5 Lightning, a 30B-A3B MoE open model that is roughly 4x faster at output and 30% faster at agentic task completion, and open-sourced NeMo Switchyard, a routing library that picks the optimal model per request. Nvidia reports a Switchyard-routed stack cuts completion cost to about a third of running Claude Opus 4.8 alone; partners report 21% lower latency (Boomi), 58% lower cost (Ramp), and 74% lower cost at a 6% accuracy tradeoff (LangChain). Meanwhile Nemotron 4, a 1T+ parameter flagship, is in training with a ~$7B cloud-compute budget through FY2028. We map the family, model the routed unit economics, and show a routing-policy implementation.