Computer-Using Agents
PulseAugur coverage of Computer-Using Agents — every cluster mentioning Computer-Using Agents across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
VeriCUA framework enhances agent verification through dynamic exploration
Researchers have introduced VeriCUA, a novel framework designed to enhance the verification process for computer-using agents (CUAs). This platform-agnostic system treats verification as a dynamic evidence-gathering exe…
-
New benchmark reveals frontier LLMs pose high misuse risks as computer-using agents
A new benchmark called CUAHarm has been developed to assess the potential misuse risks of computer-using agents (CUAs). The benchmark includes 104 realistic scenarios designed to test CUAs' capabilities in harmful actio…
-
New OSReward benchmark reveals VLM judges are too lenient for AI agents
Researchers have introduced OSReward, a new benchmark designed to evaluate the reliability of vision-language models (VLMs) when used as judges for computer-using agents (CUAs). The benchmark includes a diverse set of C…
-
New OSReward benchmark reveals VLM judges are lenient on AI agents
Researchers have introduced OSReward, a new benchmark designed to evaluate the reliability of vision-language models (VLMs) when used as judges for computer-using agents (CUAs). The benchmark includes realistic CUA traj…
-
New benchmark reveals AI agents struggle with real-world SaaS tasks
Researchers have introduced SaaS-Bench, a new benchmark designed to evaluate computer-using agents (CUAs) on realistic professional workflows. This benchmark utilizes 23 Software-as-a-Service (SaaS) systems across six d…
-
New benchmark reveals AI agents struggle with real-world SaaS tasks
Researchers have introduced SaaS-Bench, a new benchmark designed to evaluate computer-using agents (CUAs) on realistic professional workflows within Software-as-a-Service (SaaS) environments. The benchmark comprises 106…
-
Survey maps safety and security threats of autonomous computer-using agents
A new survey paper categorizes the safety and security threats posed by Computer-Using Agents (CUAs). These agents, powered by LLMs, can autonomously interact with software and interfaces, presenting novel risks. The pa…
-
Latent Space Podcast Explores AI Agents and Serverless Browsing
The Latent Space Podcast, also known as The AI Engineer Podcast, features discussions on open-source tools and the evolving landscape of AI agents. Topics covered include the development of "Open Operator," advancements…