7 min readAnomaly Detection
The Detector That Never Fires Is 99.5% Accurate
At a realistic base rate the do-nothing detector wins on accuracy, a ROC of 0.9468 hides an alert queue that is 64% false, distance from the mean scores below chance when anomalies sit at the centre, and twenty anomalies that group together hide each other from the method built to find them.
Machine LearningStatistics