Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27147

Add per-camera umbrella collections and levels of indirection for versioned root datasets

    XMLWordPrintable

    Details

    • Story Points:
      8
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      We've talked in the past about adding umbrella CHAINED collections for each instrument to gather raws, calibs, refcats, masks, etc.  It's time to do that now.

      We should also make sure any RUN-type collections created by ConvertRepoTask are truly going to be valid forever or hidden behind CHAINED collection links.  For example, it's not appropriate to put the particular version of the HSC bright object masks we find in repos today as "HSC/masks"; we probably want them to go in "HSC/masks/<version>" and have an "HSC/masks" CHAINED collection referencing that.

      Here's a more complete proposal: https://confluence.lsstcorp.org/display/DM/Standard+Collections+and+Collection+Naming+Conventions

        Attachments

          Issue Links

          is triggered by

          RFC - An issue whose primary purpose is to advertise an intent and allow stakeholders to comment. RFC-741 Policies and Conventions for Organizing Gen3 Data Repositories

          • Adopted

            Activity

            Ascending order - Click to sort in descending order
            6 older comments
            Hide
            Permalink
            mgower Michelle Gower added a comment -

            ctrl_bps passed jenkins test.  Made pull request.  Changing input collection name in example yaml must wait for pipelines_check changes.

            Show
            mgower Michelle Gower added a comment - ctrl_bps passed jenkins test.  Made pull request.  Changing input collection name in example yaml must wait for pipelines_check changes.
            Hide
            Permalink
            tjenness Tim Jenness added a comment -

            I've taken a look and made some comments previously. Removing myself from the reviewer list.

            Show
            tjenness Tim Jenness added a comment - I've taken a look and made some comments previously. Removing myself from the reviewer list.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Simon Krughoff, did you spot this review request, and do you think you'll be able to get your piece of it done sometime today or early tomorrow?

            Show
            jbosch Jim Bosch added a comment - Simon Krughoff , did you spot this review request, and do you think you'll be able to get your piece of it done sometime today or early tomorrow?
            Hide
            Permalink
            krughoff Simon Krughoff added a comment -

            Jim Bosch sorry about letting that fall off my plate.  I've reviewed my two PRs and only have one trivial comment.

            Show
            krughoff Simon Krughoff added a comment - Jim Bosch sorry about letting that fall off my plate.  I've reviewed my two PRs and only have one trivial comment.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            All reviewers have separately indicated that they're done.

            Show
            jbosch Jim Bosch added a comment - All reviewers have separately indicated that they're done.

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Michelle Gower, Simon Krughoff
              Watchers:
              Jim Bosch, Michelle Gower, Simon Krughoff, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.