Human-Centered Benchmarking of Driver Monitoring Models
Researchers have introduced a new framework for evaluating driver monitoring models, moving beyond simple accuracy metrics. The Human-Centered Benchmarking Framework (HCBF) assesses models on accuracy, explainability, efficiency, and robustness. When applied to four lightweight architectures on the MRL Eye Dataset, the study found that while models performed similarly on clean accuracy, they excelled in different dimensions. ShuffleNetV2 was ranked highest overall, but its performance degraded significantly under noisy conditions, highlighting the importance of multi-dimensional evaluation for real-world deployment. AI
IMPACT Introduces a more comprehensive evaluation method for AI models in safety-critical applications, potentially improving real-world performance and reliability.