NVIDIA has released Nemotron 3.5 Super VL, a family of large language models with up to 120 billion parameters. These models feature a hybrid architecture combining Mamba-2 and Mixture-of-Experts (MoE) for enhanced efficiency and a 1 million token context window. The models are optimized for speculative decoding and include a vision encoder for image and video processing, available under the OpenMDW license. AI
IMPACT This release offers a large context window and efficient decoding, potentially improving performance in RAG and other long-context applications.
RANK_REASON Frontier-lab model release with system card.
- C-RADIO-Encoder
- LiLiCorr Draft-Checkpoint
- Mamba-2
- Mamba-2-MoE
- MoE-Hybrid
- Multi Token Prediction
- Nemotron 3.5 Super VL
- Nemotron-3.5-Super-VL-120B-A12B
- Nemotron 3.5 Super VL 120B-A12B Base
- NVFP4
- Nvidia
- OpenMDW License
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →