Bidraft's Darwin-27B-ZTC-v5 model has achieved the top position on the S1MB benchmark, a public leaderboard for decision-making AI. This model outperformed 152 other models, including those from Perplexity and Cloudflare, by achieving a Borda score of 91.16. The S1MB benchmark evaluates AI's ability to make judgments rather than generate text, by providing probabilities for different choices, which can be directly used by programs. Darwin-27B-ZTC-v5's architecture allows for a single forward pass to output probabilities, making it efficient for large-scale operational tasks like scoring responses or routing based on difficulty. AI
IMPACT Sets a new standard for decision-making AI, potentially accelerating adoption in applications requiring rapid, programmatic judgments.
RANK_REASON The cluster reports on a new benchmark result for a decision-making AI model, detailing its performance against competitors. [lever_c_demoted from research: ic=1 ai=1.0]
- AutoJev-27B
- Bidraft
- Cloudflare
- Darwin-27B-ZTC-v5
- Hugging Face
- Jared Palmer
- Jevíčko
- Meta
- Perplexity
- Tev1-4B
- TogetherAI
- TypeSafeAI
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →