NVIDIA Nemotron 3.5 Lightning Deep Dive: 30B A3B Hybrid MoE with 1M-Token Context
NVIDIA's open-weight agentic flagship pairs a 30B-total / 3B-active A3B hybrid MoE with a 1M-token context window and ships through OpenRouter, build.nvidia.com, NeMo Switchyard, and SageMaker JumpStart. This deep dive covers the hybrid MoE trade-offs, KV cache and RoPE engineering behind the long context, benchmark positioning, and a six-step enterprise evaluation playbook.