Nemotron Labs has released Dory1.0-4B, a 4-billion-parameter language model that utilizes a novel looped architecture. This design allows the model to achieve improved accuracy and token efficiency by applying a shared block of layers multiple times, effectively trading inference compute for better performance. Dory1.0-4B has demonstrated superior results compared to larger models on various benchmarks, particularly in coding and agentic tasks, and its checkpoints are now publicly available. AI
IMPACT Introduces a novel looped architecture that improves efficiency and performance, potentially influencing future LLM designs.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
Read on Hugging Face Daily Papers →
- bfloat16
- Dory1.0-4B
- Gemma 4 12B
- Gemma 4 26B-A4B
- generative pre-trained transformer
- GGUF
- Hugging Face
- MXFP8
- Nemotron Labs
- NVFP4
- Nvidia
- Qwen3.5:9b
- Reinforcement Learning with Verifiable Rewards
- supervised fine-tuning
- transformer
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →