PulseAugur
EN
LIVE 15:31:47

Machine learning expert seeks advice on performance regression detection

A user on Reddit is seeking advice on implementing a machine learning approach for detecting performance regressions, specifically using anomaly detection techniques. They are working with a limited dataset of approximately 10 healthy samples for training and are unsure about the best practices for data splitting, threshold selection, and evaluation metrics. The user is questioning whether a traditional train/validation/test split is necessary for one-class anomaly detection and if their regression samples can serve as the test set. AI

IMPACT This discussion highlights common challenges in applying machine learning to performance monitoring and the need for robust evaluation strategies.

RANK_REASON User is asking for advice on a technical implementation, not announcing a new development.

Read on r/MachineLearning →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Machine learning expert seeks advice on performance regression detection

COVERAGE [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/ZeroDark_Hereford ·

    UrgenT Help Detecting Performance Regressions Using Machine Learning and Hardware Counters [P]

    <!-- SC_OFF --><div class="md"><p>I’m working on performance regression detection using machine learning/anomaly detection.</p> <p>My setup is basically:</p> <ul> <li>Healthy runs are used to learn normal behaviour</li> <li>Regression runs are used to see whether the model detect…