Simon Willison has developed a new tool named "smevals" in collaboration with Prime Radiant. This web application is designed for running small evaluation suites against AI models, harnesses, and prompts. The tool is interactive and requires JavaScript to function, though basic HTML interfaces are also possible. AI
IMPACT This tool could streamline the process of evaluating AI models and prompts for developers.
RANK_REASON The item describes the release of a new software tool for AI evaluations.
Read on Bluesky Jetstream — AI desk →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →