ISTA has released a new version of its DeepSeek-V4.1-Flash-1017 model, specifically a Coder build that has been compressed using GSQ and RCO techniques. This optimized version removes half of the model's routed experts, reducing its parameter count to 763.2 billion, with 551.9 billion in the transformer. The pruned model retains a high percentage of its original performance, achieving 98.7% on LiveCodeBench v6 and 94.8% on SWE-bench Verified, demonstrating its effectiveness in coding tasks. AI
IMPACT This release showcases advanced model compression techniques, potentially enabling more efficient deployment of large language models.
RANK_REASON Release of a specific model variant with performance metrics and details on compression techniques. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →