TAO: Tolerance-Aware Optimistic Verification for Floating-Point Neural Networks
Researchers have developed a new verification protocol called TAO (Tolerance-Aware Optimistic Verification) designed to ensure the integrity of floating-point neural network computations, particularly in cloud-based ML services. TAO addresses the challenge of nondeterministic floating-point execution across different hardware by accepting outputs within principled acceptance regions rather than demanding bitwise equality. The system combines theoretical worst-case bounds with empirical percentile profiles and uses a dispute game to recursively narrow down discrepancies to individual operators, making verification scalable and practical for real-world ML models. AI
IMPACT Enhances trust in ML services by providing a verifiable method for ensuring model computation integrity.