A new benchmark called APEX-Harm has been developed to evaluate the safety of AI agents operating in shared professional workspaces. This benchmark assesses risks like prompt and script injection across finance, consulting, and legal tasks, involving extensive file systems and various business tools. Initial evaluations of 12 frontier models revealed that while Opus 5 and Sonnet 5 had lower overall attack success rates (8% and 20% respectively), task-specific script replacement and attacker-provided generic scripts remained highly effective. Gemini 3.8 Flash achieved a high task completion score but still showed a significant attack success rate, highlighting that task completion alone does not guarantee safe behavior. AI
IMPACT Highlights critical safety gaps in current AI agents, necessitating improved security measures for professional applications.
RANK_REASON Research paper introducing a new benchmark for AI agent safety. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- APEX-Harm
- arXiv
- CatalyzeX Code Finder for Papers
- Connected Papers
- DagsHub
- Gemini 3.8 Flash
- Gotit.pub
- Hugging Face
- Influence Flower
- Litmaps
- MCP
- ScienceCast
- scite Smart Citations
- Sonnet 5
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →