PulseAugur
EN
LIVE 20:23:27

Microsoft launches ASSERT for application-specific AI behavior testing

Microsoft has introduced ASSERT, an open-source framework designed to simplify the testing of AI systems for specific applications. ASSERT translates natural language descriptions of desired behaviors and policies into structured tests, generating scenarios and scoring the AI's performance against these criteria. This tool aims to ensure AI systems adhere to product-specific rules and organizational guidelines, offering continuous evaluation from development through deployment. AI

IMPACT Enables more robust and application-specific AI testing, potentially accelerating safe deployment of AI in products.

RANK_REASON This is a new product launch from a major tech company, but it is a framework for testing AI rather than a core AI model release.

Read on TechCrunch AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

COVERAGE [1]

  1. TechCrunch AI TIER_1 English(EN) · Ram Iyer ·

    New Microsoft tool lets devs spin up AI behavior tests using text descriptions

    Microsoft on Tuesday took the wraps off Adaptive Spec-driven Scoring for Evaluation and Regression Testing, an open-source framework for spinning up AI evaluations.