Seed-OSS-36B-Instruct has achieved a cost-efficiency of 40.3 intelligence points per dollar, according to independent measurements. The model scored 72.6% on the GPQA benchmark and 81.5% on MMLU-Pro. These results suggest that Seed-OSS-36B-Instruct offers a competitive performance relative to its cost, potentially challenging larger, more expensive models. AI
IMPACT Demonstrates a new benchmark for cost-efficiency in LLMs, potentially influencing future model development and deployment strategies.
RANK_REASON The cluster reports on benchmark results for an open-source model, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →