TRACE: Trajectory Risk-Aware Compression for Long-Horizon Agent Safety
Researchers have introduced TRACE, a novel method for enhancing the safety of long-horizon Large Language Model (LLM) agents. TRACE addresses the challenge of detecting sparse and delayed safety risks that are often missed by traditional turn-level detectors. The system employs a Compressor-Reader design, where a Compressor encodes the entire trajectory into a condensed latent state, which a Reader then uses to evaluate safety. This approach effectively aggregates dispersed risk cues and prevents premature evidence loss, outperforming existing methods on multiple benchmarks. AI
IMPACT Enhances the ability to detect and mitigate safety risks in complex, long-term AI agent interactions.