A user benchmarked the Qwythos-9B language model, a fine-tune of Qwen 3.5 9B and Claude, across several standard evaluations. The model was tested on GSM8K for mathematical reasoning, IFEval for instruction following, and HumanEval for code generation. The results of these tests provided insights into Qwythos-9B's capabilities and limitations in these key areas. AI
IMPACT Provides insights into the performance of fine-tuned models on key reasoning and coding tasks.
RANK_REASON User benchmark of a fine-tuned language model on standard academic benchmarks. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
