PulseAugur
EN
LIVE 23:39:28

Simon Willison launches 'smevals' AI evaluation tool with Prime Radiant

Simon Willison has developed a new tool named "smevals" in collaboration with Prime Radiant. This web application is designed for running small evaluation suites against AI models, harnesses, and prompts. The tool is interactive and requires JavaScript to function, though basic HTML interfaces are also possible. AI

IMPACT This tool could streamline the process of evaluating AI models and prompts for developers.

RANK_REASON The item describes the release of a new software tool for AI evaluations.

Read on Bluesky Jetstream — AI desk →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Simon Willison launches 'smevals' AI evaluation tool with Prime Radiant

COVERAGE [1]

  1. Bluesky Jetstream — AI desk TIER_1 English(EN) · simonwillison.net ·

    I've been working with Prime Radiant building a new tool for running small eval suites against models, harnesses, and prompts - it's called "smevals", you can t

    I've been working with Prime Radiant building a new tool for running small eval suites against models, harnesses, and prompts - it's called "smevals", you can try it with "uvx smevals docs", and I wrote about it here: primeradiant.com/blog/2026/sm...