Skip to content

Validate for online integration

Hey @lis07128 ,

as we discussed together here some todos for validating our anomaly detection:

  • one loss value per window
  • create ROC-curve (on batch level)
  • set labels globally on False and label some anomaly windows (qualitiative identification) on True
  • for qualitiative identification create helper fn "labeling_bias" to synchronise traj and better isolate anomalous windows
  • choose values for the threshold that represent the whole spectrum (~ some FP and no TP)
  • create confusion matrix (on batch level)
  • adapt the labels of the conf matrix that we have anomaly as first entry and nominal as second, leading to TP on 1 row -1 col and FP on 1-2, FN on 2-1 and TN on 2-2
  • nice would be to summarize the results on some slides
Edited by Lisa-Marie Fenner