PulseAugur
EN
LIVE 13:39:08

Basalt Labs accused of AI model performance scam

Basalt Labs is accused of a significant scam involving inflated performance claims for their AI model. The company allegedly claims 99.44% accuracy on the HLE benchmark with tools, but the model released is based on Qwen2.5-7B-Instruct. Furthermore, the model served on their website is reportedly DeepSeek, suggesting a misrepresentation of their own capabilities or intellectual property. AI

RANK_REASON The item is a user-generated post on Reddit accusing a company of a scam, lacking primary source verification or broader industry impact.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Basalt Labs accused of AI model performance scam

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/WithoutReason1729 ·

    "Basalt Labs" pulling a generationally dumb scam. Incredibly stupid lmao. Claiming 99.44% on HLE with tools. Model they released is based on Qwen2.5-7B-Instruct and the model they're serving on their website is DeepSeek.

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uztylz/basalt_labs_pulling_a_generationally_dumb_scam/"> <img alt="&quot;Basalt Labs&quot; pulling a generationally dumb scam. Incredibly stupid lmao. Claiming 99.44% on HLE with tools. Model they released is…