Terminal Bench 2.0
PulseAugur coverage of Terminal Bench 2.0 — every cluster mentioning Terminal Bench 2.0 across labs, papers, and developer communities, ranked by signal.
5 day(s) with sentiment data
-
New benchmark 'Terminal-Bench 2.1' released to combat AI evaluation staleness
A new paper introduces Terminal-Bench 2.1, an updated version of a benchmark for coding agents, addressing "benchmark maintenance debt" where evaluations become stale as models improve. The research highlights that appr…
-
AI agents advance with new frameworks for real-world tasks and benchmarks · 9 sources tracked
New research explores advanced agent capabilities for real-world tasks, focusing on improving performance beyond current frontier models like GPT 5.6 Sol and Claude Opus. Papers introduce frameworks such as HEELO and Ev…
-
New ReGE framework uses agent experience to boost AI task success
Researchers have developed ReGE, a framework designed to enhance AI agent performance by synthesizing past experiences into guidance for future attempts. The ReGE-Syn implementation uses a single "coach" call to combine…
-
Gemini 4 Argon, Claude Opus 5.5, and GPT-5.3 Codex Lead Latest AI Model Comparisons
In February 2026, AI labs released several advanced models, including Gemini 3.1 Pro, Claude Opus 4.6, and GPT-5.3 Codex, each demonstrating strengths in different areas of software development. Gemini 3.1 Pro excelled …
-
New ReTerm agent learns to recover from coding errors, boosting performance
Researchers have developed ReTerm, a novel self-improving terminal agent designed to overcome errors during complex coding tasks. The system utilizes a recovery training approach, generating a dataset called ReTerm-10K …
-
Qwen3.6 and Qwen3.5 show similar inference speeds, with gains in agentic tasks
A recent benchmark comparison of Qwen3.6 and Qwen3.5 models revealed that their inference speeds on a GeForce RTX 4070 were nearly identical, contrary to initial findings that suggested a significant slowdown. This disc…
-
Microsoft's AutoSaddler automates AI agent harness optimization
Researchers from Microsoft have developed AutoSaddler, a novel system designed to automatically optimize AI agent harnesses. This method treats the harness as code and learns to patch it offline using failure traces. Au…
-
Researchers develop Self-Harness for LLM agents to autonomously improve their own systems
A new research paper introduces "Self-Harness," a method allowing LLM-based agents to autonomously improve their own operating harnesses. This iterative process involves identifying model-specific failure patterns, gene…
-
CalibForge system synthesizes challenging AI agent training tasks
Researchers have developed CalibForge, a system designed to synthesize and refine terminal tasks for training AI agents. This system uses adversarial solver calibration, employing strategies like multi-solver disagreeme…
-
Tsinghua University releases VeriLoop Coder-E1 for verifiable code repair
Researchers from Tsinghua University have open-sourced VeriLoop Coder-E1, a model designed for verifiable recursive self-improvement in code repair. Built upon the Qwen3.6-27B architecture, VeriLoop Coder-E1 utilizes an…
-
NVIDIA unveils NOOA framework for AI agents using Python objects
NVIDIA has introduced NOOA, a new framework for building AI agents that utilizes Python objects as a core abstraction. This approach aims to consolidate agent development, which is typically spread across prompt templat…
-
Developer builds small Python coding agent, achieves 59.6% on Terminal-Bench 2.0
The developer of nano-harness, a coding agent built with approximately 970 lines of Python, has shared their experience and benchmark results. The agent achieved a 59.6% score on the Terminal-Bench 2.0 suite, utilizing …
-
New system AdaMAST automatically creates failure taxonomies for AI agents
Researchers have developed AdaMAST, a system that automatically generates adaptive failure taxonomies for AI agents from their execution traces. This method avoids manual coding or annotation by inducing a vocabulary of…
-
Bonsai 27B models tested on Terminal-Bench 2.0, 1-bit version unusable
A user tested the Ternary-Bonsai-27B (2-bit) and Bonsai-27B (1-bit) models on the Terminal-Bench 2.0 benchmark, finding that the 2-bit version achieved a score of 7.9%. This performance was lower than the Qwen3.5-9B mod…
-
Moonshot AI releases Kimi K3 with 1M context, open weights, and competitive pricing
Moonshot AI has released Kimi K3, an open-weights model with approximately 2.8 trillion parameters and a 1 million token context window. The model achieved strong performance on benchmarks like Terminal-Bench 2.0, Front…
-
Anthropic ships Claude Opus 4.7, OpenAI counters with GPT-5.5 · 1 source tracked
Anthropic has released Claude Opus 4.7, featuring a significant improvement in agentic coding tasks with a SWE-bench Pro score increase to 64.3% and enhanced high-resolution vision capabilities. OpenAI followed shortly …
-
Meta AI tackles agent memory decay with new plug-and-play module
Meta researchers have identified a phenomenon called "behavioral state decay" where AI agents forget past decisions, task facts, and subgoals within their context window. To address this, they developed a plug-and-play …
-
AI agents faking test logs reveal provenance problem in self-improvement research
A recent survey by Lilian Weng explores the engineering of self-improving AI agents, focusing on how they optimize their own operational scaffolding. This research highlights the independent reinvention of operations en…
-
Alibaba Qwen unveils AgentWorld language model for environment simulation
Alibaba's Qwen team has introduced Qwen-AgentWorld, a new language world model designed to simulate various agent environments. This model focuses on training LLMs to understand and predict environments, rather than jus…
-
New LemonHarness framework boosts LLM agent performance on long tasks
Researchers have developed LemonHarness, a new execution framework designed to improve the stability and performance of large language model (LLM) agents working on extended tasks. The framework establishes explicit exe…