long-context reasoning
PulseAugur coverage of long-context reasoning — every cluster mentioning long-context reasoning across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
Open-source LLMs evaluated: DeepSeek V4 leads benchmarks
Several open-source large language models have been independently evaluated on various benchmarks, with DeepSeek V4 Flash 0420 achieving top scores in GPQA (89.4%) and Humanity's Last Exam (34.8%). Qwen3.5 4B also showe…
-
DeepSeek V4 Pro 0813 benchmarks show 10.6% on Humanity's Last Exam
DeepSeek V4 Pro 0813 has demonstrated specific performance metrics on benchmarks including Humanity's Last Exam, Long Context Reasoning, and SciCode. The model achieved 10.6% on Humanity's Last Exam, 50.7% on Long Conte…
-
Step3 VL 10B shows mixed results on benchmarks
A new evaluation of the Step3 VL 10B model reveals a significant performance disparity across different benchmarks. The model achieved a 69% score on the GPQA benchmark, indicating strong performance in graduate-level q…
-
DeepSeek V4 Pro and Nova 2.0 Lite benchmarks revealed · 2 sources tracked
Independent benchmarks reveal the performance of two large language models, DeepSeek V4 Pro and Nova 2.0 Lite. DeepSeek V4 Pro achieved high scores in reasoning-focused tasks, with 92.8% on GPQA and 80.3% on Long Contex…
-
Qwen3.5 2B shows mixed results in independent benchmarks
Independent benchmarks reveal that Qwen3.5 2B, a non-reasoning model, achieves 43.8% on the GPQA benchmark. However, its performance significantly drops on more complex tasks, scoring only 5% on HLE, 15% on Long Context…
-
LLM Benchmark Results: Molmo, Qwen3, Hermes, and Mistral Performance Revealed
Independent benchmarks reveal varying performance across several large language models. Molmo 7B-D shows low scores on GPQA and MMLU-Pro, while Qwen3 Omni 30B A3B and Hermes 4 - Llama-3.1 405B demonstrate significantly …
-
LFM2 8B A1B model shows mixed benchmark results
The LFM2 8B A1B model achieved a score of 50.5% on the MMLU-Pro benchmark. However, its performance on Long Context Reasoning was notably low, scoring only 1%. This disparity suggests potential issues with the evaluatio…
-
Sarvam 30B model performance metrics revealed across benchmarks
Sarvam AI has released its Sarvam 30B model, with performance metrics now available for several benchmarks. The model achieved 63.3% on GPQA, 7.5% on Humanity's Last Exam, and 19.2% on SciCode. Notably, it scored 0% on …
-
LLM performance benchmarks released for Llama, GLM, and Mistral models · 4 sources tracked
Independent benchmarks reveal performance metrics for several large language models, including Llama 3.2 Instruct 90B, GLM-4.7-Flash, Mistral Large 2, and Llama 3.1 Instruct 8B. The data highlights scores across various…
-
LLM benchmarks show mixed results for Kimi, Qwen3, and Exaone models
Independent benchmarks reveal varying performance across several large language models. Kimi K2 0905 achieved strong scores on GPQA and MMLU-Pro, while Qwen3 235B A22B also performed well on these metrics but struggled …
-
LLM benchmark results reveal performance across multiple models · 9 sources tracked
A recent independent benchmark evaluation has revealed performance metrics for several large language models, including Kimi K2, Sarvam Maya, NVIDIA Nemotron 3 Super 120B, DeepSeek V3.2, Falcon H1R-7B, GLM-5.2, GLM-5.1,…
-
DBRX Instruct and Mistral Medium 3 benchmark results revealed
Independent benchmarks reveal performance metrics for two large language models. DBRX Instruct achieved scores of 33.1% on GPQA, 39.7% on MMLU-Pro, 6.6% on Humanity's Last Exam, and 9.3% on LiveCodeBench. Mistral Medium…
-
Open-source LLMs show strong benchmark performance across multiple metrics · 4 sources tracked
Several open-source AI models have demonstrated strong performance on various benchmarks, according to independent measurements. Mi:dm K 2.5 Pro achieved 70.1% on GPQA and 80.9% on MMLU-Pro, while MiMo-V2-Flash showed 8…