PulseAugur
EN
LIVE 07:58:19

Anomaly detection metrics analyzed for imbalanced datasets

This research paper delves into the complexities of evaluating anomaly detection models, particularly when faced with significant class imbalance. The authors analyze the behavior of common metrics like AUROC, AUPR, F1-score, and MCC across varying levels of imbalance. They introduce the concept of metric landscapes, which visually represent how metric values relate to true positive and true negative rates, offering a clearer understanding of metric preferences and stability. The findings aim to provide practical guidance for researchers and practitioners in interpreting and comparing anomaly detection results across datasets with different imbalance ratios. AI

IMPACT Provides guidance on interpreting anomaly detection results, crucial for developing more robust AI systems in imbalanced data scenarios.

RANK_REASON Academic paper analyzing evaluation metrics for anomaly detection. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv stat.ML →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Anomaly detection metrics analyzed for imbalanced datasets

COVERAGE [1]

  1. arXiv stat.ML TIER_1 English(EN) · Romain Hermary, Nesryne Mejri, Djamila Aouada ·

    An Insight on Evaluation Metrics Under the Imbalanced Case of Anomaly Detection

    arXiv:2607.22286v1 Announce Type: cross Abstract: Anomaly detection is inherently characterised by severe class imbalance, making the interpretation of evaluation metrics challenging. Although metrics such as AUROC, AUPR, F1-score, and MCC are widely used, their values convey dif…