Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: Validation
-
Labels:None
-
Story Points:4.25
-
Epic Link:
-
Team:SQuaRE
Description
1. Add pass/fail routine to report success/fail against metrics. Do this for
- SRD
- Configured metrics
2. Add pass/fail reporting to running of `validate.drp.run`
Adds steps to bin.src/validateDrp and routines to the libraries to score performance against SRD or custom-specified requirements.
Outputs statistics, thresholds, and pass/fail scores to STDOUT by default.
The scoring requires only the input of the summary statistic JSON files and a configuration file that specified requestements to check. Scores pass/fail are calculated against both custom requirements and the LSST SRD requirements.
The output of scoreMetrics could be easily connected to some other output structure for a test harness.