MLCommons
PulseAugur coverage of MLCommons — every cluster mentioning MLCommons across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Google DeepMind pilots double-blind AI evaluations to prevent model cheating
Google DeepMind has developed a novel method for conducting double-blind evaluations of advanced AI models to prevent cheating by AI agents or developers. This approach utilizes Google Cloud's Confidential Computing to …
-
First double-blind evaluation of proprietary AI model conducted
A significant collaboration between AVERI, Google DeepMind, OpenMined, and MLCommons has resulted in the first-ever double-blind evaluation of a proprietary language model. This milestone involved both technical and ins…
-
AI benchmarking tools: Custom builds vs. existing solutions explored
The author of a blog focused on AI hardware and model performance investigated whether their custom-built benchmarking tools were necessary or if existing solutions could have been utilized. They found that while hardwa…
-
Amazon Nova 2 Lite uses new prompts for content moderation
Amazon has detailed how its Nova 2 Lite model can be effectively prompted for content moderation tasks. A new technical report and blog post explain how structured, taxonomy-driven prompting, aligned with the MLCommons …
-
OpenSSF launches AI/ML security working group
The Open Source Security Foundation (OpenSSF) has launched a working group focused on the intersection of AI/ML and security. This group aims to explore the security risks associated with AI technologies like LLMs and G…
-
OpenAI unveils GPT-5.6, expands ChatGPT Ads, and explores enterprise AI adoption · 10 sources tracked
OpenAI has announced GPT-5.6, a new frontier intelligence model emphasizing increased intelligence per token, improved performance per dollar, and enhanced on-demand capabilities for complex tasks. This release follows …
-
MLC enables running large models on browsers, iPhones, and AMD cards
The Machine Learning Compilation (MLC) group, led by Tianqi Chen at CMU, is developing frameworks like MLC Chat and Web LLM to enable running large language models on consumer hardware, including iPhones and web browser…