PulseAugur
EN
LIVE 18:00:30

Developer builds quiz to test human vs. AI on expert-level exam

A developer has created a web-based quiz called "Humans vs. Humanity's Last Exam" that pits human players against advanced AI models on challenging academic questions. The quiz utilizes the "Humanity's Last Exam" dataset and runs on Cloudflare Workers, employing encryption and server-side validation to prevent cheating. Player scores are tracked on a leaderboard using Cloudflare Durable Objects, and the development process itself was documented using a tool called Entire. AI

IMPACT This project highlights the increasing capability of AI models on complex academic tasks and provides a platform for comparing human and AI performance.

RANK_REASON The item describes a developer-created application that uses existing AI models and infrastructure, rather than a new release from a frontier lab or a significant industry event.

Read on dev.to — LLM tag →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Developer builds quiz to test human vs. AI on expert-level exam

COVERAGE [1]

  1. dev.to — LLM tag TIER_1 English(EN) · Lizzie Siegle ·

    Can You Beat an LLM? Building Humans vs. Humanity's Last Exam

    <p>Frontier models are crushing benchmark after benchmark...so I built a quiz to ask this simple yet humbling question: can a human still beat them?</p> <p><strong>Humans vs. HLE</strong> is a web-based quiz that pits you against frontier AI models on <a href="https://agi.safe.ai…