Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Story Points:1
-
Epic Link:
-
Team:Data Facility
Description
Run matchedVisitMetrics.py validateDrp.py and reportPerformance.py with the HSC RC2 w_2018_18 outputs from DM-14243.
Attachments
Issue Links
Activity
Using the ticket branch of DM-14342, I was able to run the same validateDrp.py command without errors.
Same as in DM-14256, the NB0921 filter needs to be excluded, otherwise the following errors were seen:
File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/validateDrp.py", line 101, in <module>
|
validate.run(args.repo, **kwargs)
|
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 161, in run
|
print_metrics(job)
|
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 464, in print_metrics
|
metric = job.metrics[metric_set[0]] # Pick the first one for the description
|
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/verify/15.0-1-g8f0875c/python/lsst/verify/metricset.py", line 207, in __getitem__
|
return self._metrics[key]
|
KeyError: Name('release', 'PF1')
|
|
|
|
|
Traceback (most recent call last):
|
File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/reportPerformance.py", line 69, in <module>
|
release_level=args.release_level)
|
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 52, in run
|
input_table = objects_to_table(input_objects, level=srd_level)
|
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 120, in objects_to_table
|
spec_set = specs[metric]
|
KeyError: 'PA1'
|
Hsin-Fang Chiang
added a comment - Using the ticket branch of DM-14342 , I was able to run the same validateDrp.py command without errors.
Same as in DM-14256 , the NB0921 filter needs to be excluded, otherwise the following errors were seen:
File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/validateDrp.py", line 101, in <module>
validate.run(args.repo, **kwargs)
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 161, in run
print_metrics(job)
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/validate.py", line 464, in print_metrics
metric = job.metrics[metric_set[0]] # Pick the first one for the description
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/verify/15.0-1-g8f0875c/python/lsst/verify/metricset.py", line 207, in __getitem__
return self._metrics[key]
KeyError: Name('release', 'PF1')
Traceback (most recent call last):
File "/home/hchiang2/weeklies/w18/packages/validate_drp/bin/reportPerformance.py", line 69, in <module>
release_level=args.release_level)
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 52, in run
input_table = objects_to_table(input_objects, level=srd_level)
File "/home/hchiang2/weeklies/w18/packages/validate_drp/python/lsst/validate/drp/report_performance.py", line 120, in objects_to_table
spec_set = specs[metric]
KeyError: 'PA1'
Results and logs are at {{/datasets/hsc/repo/rerun/RC/w_2018_18/DM-14243/validateDrp }}
A web access is at https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_18/validate_drp/
Hsin-Fang Chiang
added a comment - Results and logs are at {{/datasets/hsc/repo/rerun/RC/w_2018_18/ DM-14243 /validateDrp }}
A web access is at https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_18/validate_drp/ 
validateDrp.py is broken:
$ validateDrp.py /datasets/hsc/repo/rerun/RC/w_2018_18/DM-14243/validateDrp/matchedVisitMetrics/9615/HSC-G/matchedVisit_HSC-G.json --noplotTraceback (most recent call last):File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-7-gea15604/bin/validateDrp.py", line 101, in <module>validate.run(args.repo, **kwargs)File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/validate_drp/15.0-7-gea15604/python/lsst/validate/drp/validate.py", line 147, in runjob = load_json_output(json_path, **kwargs)TypeError: load_json_output() got an unexpected keyword argument 'verbose'I've filed
DM-14342