NVIDIA has released its Nemotron-Labs-3-Puzzle-75B model, optimized for serving on Blackwell hardware. The model incorporates LatentMoE with Mamba-Interleaving and Multi-Token Prediction (MTP) for enhanced throughput. It is available under the OpenMDW-1.1 license, permitting commercial use. AI
IMPACT Optimizes serving infrastructure and potentially increases throughput for large models.
RANK_REASON NVIDIA is a frontier lab releasing a new model with specific technical details.
Read on Mastodon — mastodon.social →
- 8×B200
- Blackwell
- Iterative Puzzle
- LatentMoE
- Mamba
- Mamba2
- Mamba-Interleaving
- MTP heads
- Multi Token Prediction
- Nemotron-Labs-3-Puzzle-75B-A9B
- Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4
- Nemotron-Labs-3-Puzzle-75B-FP8
- NVFP4 Quantization
- NVIDIA
- Nvidia B200
- NVIDIA H100
- OpenMDW-1.1
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →