Retrospective Harness Optimization: Improving LLM Agents via Self-Preference over Trajectory Rollouts
Researchers have developed new methods to improve the reliability and safety of AI agents. One approach, TRACE, focuses on monitoring long-horizon agent trajectories to detect malicious or unintended behaviors by analyzing evidence across temporally distant actions. Another method, Retrospective Harness Optimization (RHO), uses past trajectories to self-supervise and improve an agent's harness of skills and tools without external validation. Additionally, HarnessFix aims to diagnose and repair flaws within an agent's harness by analyzing execution traces and mapping failures to specific harness layers for targeted patching. AI
IMPACT These advancements aim to make AI agents more robust, reliable, and safer by improving their ability to handle complex tasks and avoid unintended consequences.