The Darwin-27B-ZTC-v9 model has achieved the top position on the S1mba English leaderboard, which tracks 137 benchmarks and 197 models. This model is designed for decision-making tasks, utilizing a "zero token choice" approach that bypasses text generation for faster, more reliable probability outputs. Unlike traditional models that average scores, S1mba uses a Borda count aggregation, ranking each benchmark individually to determine overall performance, emphasizing consistent performance across a wide range of tasks. AI
IMPACT This model's focus on decision-making and calibration could enable more reliable AI gates and efficient agent operations by reducing computational costs for checks.
RANK_REASON Model release with benchmark results and open weights.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →