SciCode
PulseAugur coverage of SciCode — every cluster mentioning SciCode across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
Ricursive Intelligence releases Ripple-65B Preview, a 65B open-weight coding model · 8 sources tracked
Ricursive Intelligence has released Ripple-65B Preview, a 65-billion-parameter open-weight language model. This model achieves a strong performance on the TerminalBench 2.1 coding benchmark, scoring 80.5 and surpassing …
-
Artificial Analysis revamps AI model rankings with new index
Artificial Analysis has updated its Intelligence Index v5, significantly altering the AI model rankings. The new index heavily relies on private, unseen test sets (60%) and equally weights Knowledge Work, Coding, Scienc…
-
LLM benchmarks reveal performance across GPQA, SciCode, and reasoning tasks
Independent benchmarks reveal the performance of several large language models across various metrics. Muse Spark Open achieved 89% on GPQA and 58.4% on SciCode, while Muse Glimmer scored 83.5% on GPQA and 44.9% on SciC…
-
Developer creates local GPU benchmark server for open-weight LLMs
A developer has created a local GPU benchmark server to evaluate the performance of open-weight LLMs, particularly quantized versions, on consumer hardware. The server, equipped with two RTX 5060 Ti cards, tests models …
-
Open-source LLMs evaluated: DeepSeek V4 leads benchmarks
Several open-source large language models have been independently evaluated on various benchmarks, with DeepSeek V4 Flash 0420 achieving top scores in GPQA (89.4%) and Humanity's Last Exam (34.8%). Qwen3.5 4B also showe…
-
Opus 5.5 benchmarks show mixed results: first in general, third in secure code
Recent independent benchmarks for Anthropic's Opus 5.5 present conflicting results. One evaluation by Artificial Analysis places Opus 5.5 in first place overall, outperforming OpenAI's GPT-6 Astra and Anthropic's own Fa…
-
DeepSeek V4 Pro 0813 benchmarks show 10.6% on Humanity's Last Exam
DeepSeek V4 Pro 0813 has demonstrated specific performance metrics on benchmarks including Humanity's Last Exam, Long Context Reasoning, and SciCode. The model achieved 10.6% on Humanity's Last Exam, 50.7% on Long Conte…
-
Developer launches Livenerf to objectively track Claude Opus 5.5 performance
A developer has launched an open-source project called Livenerf to objectively track the performance of Anthropic's Claude Opus 5.5 model over time, addressing the common user suspicion that models are "nerfed" after th…
-
DeepSeek V4 Pro and Nova 2.0 Lite benchmarks revealed · 2 sources tracked
Independent benchmarks reveal the performance of two large language models, DeepSeek V4 Pro and Nova 2.0 Lite. DeepSeek V4 Pro achieved high scores in reasoning-focused tasks, with 92.8% on GPQA and 80.3% on Long Contex…
-
New Quantum-Classical Hybrid AI Architecture Boosts Long-Horizon Reasoning
Researchers have introduced QART, a novel quantum-classical hybrid architecture designed to improve long-horizon reasoning in AI models. QART integrates a backbone language model with quantum encoding, optimization, and…
-
Artificial Analysis Intelligence Index v4.2 released, Anthropic leads rankings
Artificial Analysis has released version 4.2 of its Intelligence Index, introducing new evaluations like AA-Briefcase for agentic knowledge work and GDP.pdf for long-context document reasoning. This update increases the…
-
Nvidia releases quantized Alibaba Qwen3.8-27B model for AI agents
Nvidia has released a quantized version of Alibaba's Qwen3.8-27B language model, optimized for deployment in AI agent systems and other applications. This model, named nvidia/Qwen3.8-27B-NVFP4, utilizes Nvidia's Model O…
-
Qwen3.5 2B shows mixed results in independent benchmarks
Independent benchmarks reveal that Qwen3.5 2B, a non-reasoning model, achieves 43.8% on the GPQA benchmark. However, its performance significantly drops on more complex tasks, scoring only 5% on HLE, 15% on Long Context…
-
Kimi K2.5 achieves strong benchmark scores with competitive pricing
Kimi K2.5 has achieved notable performance on several benchmarks, including GPQA, HLE, Long Context, and SciCode. The model offers competitive pricing at 30 integer points per dollar across these evaluations. These resu…
-
AI models nearing saturation on scientific coding benchmarks, Reddit discussion reveals
A discussion on Reddit's r/singularity forum explores the saturation point of AI models on scientific coding benchmarks, specifically SciCode, HLE, and CritPt. The analysis suggests that while HLE and CritPt show monthl…
-
Sarvam 30B model performance metrics revealed across benchmarks
Sarvam AI has released its Sarvam 30B model, with performance metrics now available for several benchmarks. The model achieved 63.3% on GPQA, 7.5% on Humanity's Last Exam, and 19.2% on SciCode. Notably, it scored 0% on …
-
LLM performance benchmarks released for Llama, GLM, and Mistral models · 4 sources tracked
Independent benchmarks reveal performance metrics for several large language models, including Llama 3.2 Instruct 90B, GLM-4.7-Flash, Mistral Large 2, and Llama 3.1 Instruct 8B. The data highlights scores across various…
-
Meta's Muse Spark 1.2 shows rapid performance gains, rivals top AI models
Meta's latest foundational model, Muse Spark 1.2, has achieved high scores in third-party performance analyses, demonstrating rapid improvement since the Muse series' debut four months ago. The model notably surpassed G…
-
Gemma 4's top ranking on SciCode benchmark questioned by users
A user on Reddit's r/LocalLLaMA community is questioning the ranking of Gemma 4 above Qwen-3.6 27B on the SciCode benchmark, as reported by artificialanalysis.ai. The user expresses surprise, stating that this ranking c…
-
New method enhances LLM scientific computing by consolidating experience
Researchers have developed a new method called SciConsolidate to improve the scientific computing capabilities of large language models. This technique converts runtime experience from solving problems into transferable…