tau-Bench
PulseAugur coverage of tau-Bench — every cluster mentioning tau-Bench across labs, papers, and developer communities, ranked by signal.
-
New research argues AI alignment can't be judged by model-level tests alone
A new paper argues that evaluating AI alignment solely at the model level is insufficient for understanding its real-world deployment. The research highlights that current benchmarks lack user-facing verification and pr…
-
AgentEval framework improves AI agent workflow evaluation with DAG-based error tracking
Researchers have developed AgentEval, a new framework for evaluating agentic workflows by representing them as directed acyclic graphs (DAGs). This approach allows for detailed step-level assessment and tracking of erro…
-
New metrics quantify LLM agent behavioral similarity and convergence
A new paper introduces two metrics, Response Pattern Similarity (RPS) and Action Graph Similarity (AGS), to quantify how similar the tool-use behaviors of different AI agents are. These metrics aim to distinguish betwee…