tau^2-Bench
PulseAugur coverage of tau^2-Bench — every cluster mentioning tau^2-Bench across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
New FraudBench benchmark tests AI banking agents against adaptive fraud
Researchers have introduced FraudBench, a new benchmark designed to test the safety of conversational AI agents in banking environments. Unlike existing benchmarks that focus on static transactions or generic harmful us…
-
New method distills reasoning skills into language models, cutting token costs
Researchers have developed a method to improve the efficiency of reasoning in language models by distilling knowledge into compact natural-language skills. This approach amortizes the cost of reasoning, which typically …
-
New framework generates synthetic data to boost small language model function-calling
Researchers have developed Data Turnstile, an open-source framework designed to generate high-quality synthetic training data for function-calling tasks, specifically targeting small language models (SLMs). This framewo…
-
Living-Harness system enhances LLM agent reliability through self-evolution · 2 sources tracked
Researchers have developed Living-Harness, a novel system designed to improve the reliability of large language model (LLM) agents. Unlike static harnesses that use fixed parameters, Living-Harness dynamically updates i…
-
Meta-TTL framework optimizes language agent adaptation policies
Researchers have developed Meta-TTL, a novel framework designed to optimize the adaptation policies of language agents for improved performance at inference time. Unlike existing methods that use fixed policies, Meta-TT…
-
New BREW framework enables LLM agents to learn from experience
Researchers have developed BREW, a novel framework designed to enable Large Language Model (LLM)-based agents to learn from past experiences. Unlike current agents that restart learning with each session, BREW distills …
-
New framework CurateEvo enhances LLM agent post-training data curation · 2 sources tracked
Researchers have developed CurateEvo, a novel framework for dynamically evolving data curation strategies to improve the post-training of large language model (LLM) agents. This failure-driven approach iteratively refin…
-
New protocol questions gains in multi-agent LLM coordination benchmarks
A new paper proposes a paired noise-floor protocol for evaluating multi-agent LLM coordination. The study found that the observed coordination gains in previous research might be within the margin of error, suggesting t…
-
EnvFactory automates LLM tool-use training with synthesized environments
Researchers have developed EnvFactory, an automated framework designed to enhance the tool-use capabilities of large language models through agentic reinforcement learning. This system synthesizes executable tool enviro…
-
New metrics quantify LLM agent behavioral similarity and convergence
A new paper introduces two metrics, Response Pattern Similarity (RPS) and Action Graph Similarity (AGS), to quantify how similar the tool-use behaviors of different AI agents are. These metrics aim to distinguish betwee…