Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-19638

Create parent task/script for bootstrapping Gen3 repos

    Details

    • Templates:
    • Story Points:
      4
    • Team:
      Data Release Production

      Description

      Building on recent work to enable bootstrapping the Gen3 ci_hsc dataset with minimal reliance on gen2convert (DM-19614, DM-19615, DM-19622, DM-19531, DM-19272) and improvements to gen2convert itself (DM-18023), write a task/script that can be used to similarly bootstrap other Gen3 repos, starting with RC2.

      Steps will include:

      • register instrument(s)
      • add curated calibrations, via Instrument.writeCuratedCalibrations
      • register skymaps(s)
      • ingest raws, via RawIngestTask
      • add Gen2-calib-repo calibrations, refcats, and BrightObjectMasks via explicit, lower-level calls to gen2convert code in daf_butler.

      I do not currently plan to include actually creating the empty repository, which will save this task from having to somehow read in and apply overrides to butler yaml configuration.

        Attachments

          Container Issues

            Issue Links

              Activity

                People

                • Assignee:
                  jbosch Jim Bosch
                  Reporter:
                  jbosch Jim Bosch
                  Reviewers:
                  Hsin-Fang Chiang
                  Watchers:
                  Hsin-Fang Chiang, Jim Bosch
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  2 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel