Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: daf_butler, pipe_tasks
-
Labels:
-
Story Points:4
-
Epic Link:
-
Team:Data Release Production
Description
Building on recent work to enable bootstrapping the Gen3 ci_hsc dataset with minimal reliance on gen2convert (DM-19614, DM-19615, DM-19622, DM-19531, DM-19272) and improvements to gen2convert itself (DM-18023), write a task/script that can be used to similarly bootstrap other Gen3 repos, starting with RC2.
Steps will include:
- register instrument(s)
- add curated calibrations, via Instrument.writeCuratedCalibrations
- register skymaps(s)
- ingest raws, via RawIngestTask
- add Gen2-calib-repo calibrations, refcats, and BrightObjectMasks via explicit, lower-level calls to gen2convert code in daf_butler.
I do not currently plan to include actually creating the empty repository, which will save this task from having to somehow read in and apply overrides to butler yaml configuration.
I'm hoping to get this into the weekly on Friday, so I figured I'd send this to you now even though I'm still testing my cleanups to obs_base (where most of the code is) before putting them on the tickets branch. So the PRs that are ready now are:
The last is in lsst-dm, so it doesn't formally need a review, but I figure it's always good to get two eyes on any new code.
I'll post the obs_base PR as soon as that testing completes and I've moved my cleaned-up version from u/jbosch/ to tickets/.