Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation
Researchers have developed SafeGen-Bench, a new benchmark designed to evaluate the safety of image-conditioned text-to-video generation models. The benchmark addresses the challenge of harmful content being generated even from safe text and image inputs, defining 10 malicious categories focused on temporal sequences and depicted behaviors. Initial evaluations show current models struggle with safety, achieving unsafety scores up to 44.5, and that unimodal guardrails are insufficient, failing 80% of the time across seven malicious categories. AI
IMPACT Highlights critical safety vulnerabilities in current text-to-video models, necessitating improved guardrails and evaluation methods for responsible AI development.