Cracks in the Foundation: A Civil Infrastructure Dataset to Challenge Vision Foundation Models
Researchers have introduced "Cracks in the Foundation" (CiF), a new dataset designed to challenge vision foundation models in the domain of civil infrastructure inspection. The dataset, comprising approximately 150,000 images curated over five years with civil engineering experts, highlights a significant gap in current AI capabilities for precise, pixel-level defect segmentation. Evaluations show that even advanced zero-shot foundation models struggle with real-world infrastructure, and specialized models plateau at a low performance level, indicating fundamental weaknesses in models trained primarily on internet images. AI
IMPACT Highlights limitations in current vision models for critical infrastructure monitoring, suggesting a need for more domain-specific training and evaluation.