Details
-
Type:
Epic
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Epic Name:s19a-drp-pipelinetask
-
Story Points:100
-
Sprint:DRP S19-3
-
WBS:02C.04.01
-
Team:Data Release Production
-
Cycle:Spring 2019
Description
This epic will capture DRP's efforts toward Gen 3 middleware, primarily Nate Lust, Chris Waters, and Jim Bosch with some initial effort from Yusra AlSayyad. This includes work done toward the January 31st deadline to demo a DRP with the Gen3 butler:
- Quickly converting the Tasks run in an HSC DRP (except meas_mosaic or sky correction) by Jan 31st to demonstrate that a DRP can be run with a Gen 3 butler. These conversions will "break the rules" and add shims where needed.
- Gen3 Butler and PipelineTask features and bugfixes as needed.
Work this cycle to be continued on: https://jira.lsstcorp.org/browse/DM-16771
This epic culminated in the conversion of all* tasks run in ci_hsc, starting with IsrTask and ending with ForcedPhotCcdTask.
During the demo on Feb 1st, Nate presented the state of Pipeline Tasks from a Science Pipelines perspective in:
https://lsst-dm.github.io/PipelineTask_demo_presentation/
and demonstrated a full DRP being run on the ci_hsc dataset with Gen 3 middleware
* The exception was SkyCorrectionTask which was an HSC-specific feature ported from NAOJ, implemented as a pipe_driver rather than a regular task in pipe_tasks. pipe_drivers will be tackled in
DM-16771