Open-vocabulary object detection confidence scores are biased, study finds

A new arXiv paper reveals that confidence scores in open-vocabulary object detection models are unreliable, conflating object scale and semantic specificity with true detection signals. Researchers demonstrated that large objects receive systematically inflated scores due to scale bias, while generic queries are suppressed by semantic bias. These issues are inherent to the image-level pretraining of foundation models like CLIP, and cannot be fully resolved by simple threshold adjustments. While temperature scaling can improve recall for small objects, it comes at a cost to precision, indicating a fundamental limitation in adapting these models for region-level detection tasks. AI

IMPACT Reveals fundamental limitations in adapting image-level foundation models for region-level detection tasks, impacting future model development.

RANK_REASON Academic paper detailing a new finding about AI model limitations. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CV →

• arXiv
• COCO
• GroundingDINO
• Hugging Face
• LVIS
• OWL-ViT
• YOLO-World

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →