Fix Version/s: None
Decide and document the stack version, task steps, and configs to be used in the upcoming reprocessing of the HSC PDR1 data on the Verification Cluster.
w_2017_17 became available today, and will be used in
Main documentation of the reprocessing: https://confluence.lsstcorp.org/display/DM/S17B+HSC+PDR1+reprocessing
Additional notes on the pipelines: https://confluence.lsstcorp.org/display/~hchiang2/S17B+Output+dataset+types+of+pipe_drivers+tasks+for+HSC
John Swinbank you may want to wait for the review of
DM-10129; please put this to Reviewed when the DRP team is happy with this version/setup/config and I have the permission to start the full PDR1 reprocessing.
Checking through the items in
DM-10350: DM-10315: does not matter as it only changed defects since 2016 DM-10267, DM-10430: changes in middleware DM-10449: should not be essential; previous HSC production were run without it. DM-10451: May be best to include it.
Here is my proposal: I'll use the w_2017_17 stack with a new, post-
DM-10451 obs_subaru, which will basically be w_2017_17 + DM-10315 + DM-10449 + DM-10451.
John Swinbank what do you think?
[Edit: post-DM-10451, not post-DM-10129]
Thanks for signing this off! I'll go ahead without
DM-10451. I'll use the w_2017_17 stack + master meas_mosaic/obs_subaru/ctrl_pool as of today built with w_2017_17; effectively this is w_2017_17 + DM-10315 + DM-10449 + DM-10430.
If I understand correctly, the CModel config change of
DM-10451 matters more in coadd and beyond. We have some time before any coadd processing; I'll check the status of DM-10451 before starting coadd.
For future reference, I started coadd processing without
DM-10451 (i.e. a consistent package setup). I'll make notes on the confluence page.
The weekly w_2017_17 (~24-Apr-2017) will have all the important HSC fixes.
Steps/configs: (also noted on https://confluence.lsstcorp.org/display/DM/S17B+HSC+PDR1+reprocessing )
Unless otherwise noted, the HSC default config in the stack is used (task defaults + obs_subaru overrides).
That implies the PS1 reference catalog "ps1_pv3_3pi_20170110" in the LSST format (HTM indexed) is used (/datasets/refcats/htm/ps1_pv3_3pi_20170110/).
The calibration dataset is the 20170105 version from Paul Price; the calibration repo is located at /datasets/hsc/calib/20170105 from (