Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Story Points:1
-
Epic Link:
-
Team:Data Facility
Description
Run pipe_analysis scripts
- visitAnalysis
- coaddAnalysis
- colorAnalysis
- compareVisitAnalysis
- compareCoaddAnalysis
and validate_drp
- matchedVisitMetrics.py
- validateDrp.py
- reportPerformance.py
Upload the validate_drp metrics (json files) to SQuaSH:
- dispatch_verify.py
with the w_2019_14 RC2 outputs from DM-18300
Attachments
Issue Links
Activity
With w_2019_14, matchedVisitMetrics.py, validateDrp.py and reportPerformance.py were run with SFM and mosaic results. filter=NB0921 is ignored for validateDrp.py due to DM-15127.
validate_drp results and logs are at
/datasets/hsc/repo/rerun/RC/w_2019_14/DM-18300/validateDrp/
and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/
Hsin-Fang Chiang
added a comment - With w_2019_14 , matchedVisitMetrics.py , validateDrp.py and reportPerformance.py were run with SFM and mosaic results. filter=NB0921 is ignored for validateDrp.py due to DM-15127 .
validate_drp results and logs are at
/datasets/hsc/repo/rerun/RC/w_2019_14/ DM-18300 /validateDrp/
and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/ Some metrics shown in SQuaSH have increased; this is expected by the AM1 computation changes in DM-18638
Hsin-Fang Chiang
added a comment - Some metrics shown in SQuaSH have increased; this is expected by the AM1 computation changes in DM-18638 Hsin-Fang Chiang
added a comment - compareVisitAnalysis and compareCoaddAnalysis failed because pipe_analysis wasn't updated for the DM-10156 changes; DM-19185 has been filed. Hsin-Fang Chiang
added a comment - compareVisitAnalysis and compareCoaddAnalysis were re-done using pipe_analysis after the DM-19185 fix was merged.
coaddAnalysis.py, compareCoaddAnalysis.py, and colorAnalysis.py used the rerun repo of RC/w_2019_14/ DM-18300 -jointcal pipe_analysis logs are at
/datasets/hsc/repo/rerun/RC/w_2019_14/DM-18300-jointcal/qaLogs/
They can also be accessed via
https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2019_14
Hsin-Fang Chiang
added a comment - pipe_analysis logs are at
/datasets/hsc/repo/rerun/RC/w_2019_14/ DM-18300 -jointcal/qaLogs/
They can also be accessed via
https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2019_14 It looks like the above link points to the wrong rerun (it leads to https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2019_06).
Thanks Lauren for pointing it out!
Somehow the link wasn't set correctly. It should be
https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2019_14
Hsin-Fang Chiang
added a comment - Thanks Lauren for pointing it out!
Somehow the link wasn't set correctly. It should be
https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2019_14 
Use w_2019_14 and the master branch of pipe_analysis at the time of w_2019_14 release (at commit a574165).
The pipe_analysis comparison scripts are run against the rerun of RC/w_2019_10/
DM-17940Since last month for colorAnalysis, also set up lsst_sims to match the weekly lsst_distrib; the meta-package with the sims_w_2019_14 tag is used. This is to get the per-source Galactic Extinction applied.