BenchLM
PulseAugur coverage of BenchLM — every cluster mentioning BenchLM across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
Google doubles Gemini 1.5 Pro price for prompts over 128K tokens
Google has doubled the per-token price for its Gemini 1.5 Pro model once prompts exceed 128,000 tokens. This price increase makes Gemini 1.5 Pro more expensive for long prompts compared to its previous pricing, though i…
-
AI coding tools face new rate limits, MonkeysCode offers bypass
A new audit by BenchLM has revealed that many AI coding assistants are implementing aggressive rate limits, often capping usage at 20% per 5-hour window. These limits, coupled with the expiration of grandfathered allowa…
-
LLM Leaderboards Show Disagreement on Top Open-Weight Models
A recent audit of two prominent LLM leaderboards, BenchLM and Artificial Analysis, reveals significant discrepancies in how open-weight models are ranked and categorized. While both platforms list MiMo-V2.6-Pro as the t…
-
AI token prices plummeting, challenging trillion-dollar boom thesis
The economic thesis for the AI boom, which relies on ever-increasing demand and spending on AI compute, is showing signs of strain. Data indicates that the cost per token for AI services has significantly decreased, wit…
-
Zhipu AI releases GLM-5.2 with 1M context window, challenging top proprietary models
Zhipu AI has released GLM-5.2, a 744B-parameter Mixture-of-Experts model featuring a 1 million token context window and MIT-licensed weights. This model achieves a high ranking on the BenchLM leaderboard and demonstrate…
-
AI models compared across 7 capabilities: GPT-5.5, Claude Opus 4.8 lead
A comparative analysis of eight AI models across seven capability dimensions reveals no single all-around champion. GPT-5.5 excels in agentic tasks and long context, while Claude Opus 4.8 leads in coding and general kno…
-
AI benchmarks fail to measure real-world reliability, author warns
The author argues that current AI benchmarks are misleading, as they fail to measure crucial aspects like factual accuracy and the tendency to hallucinate plausible but false information. Despite high scores on benchmar…