Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21849

Make runs a type of collection

    XMLWordPrintable

    Details

      Description

      See https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization; this should move the schema from something like the "Partition datasets (only)" to the final design  on that page.

      Superseded by https://confluence.lsstcorp.org/display/DM/Architectural+Prototype+for+the+New+Gen3+Registry (which is not that different). Goal of this ticket is now to make runs a type of collection; this involves:

      • requiring registration for new tagged collections as well as runs;
      • giving the (recursive) tagged collection associated with a processing run a different name than the run-collection. This will probably be the responsibility of pipetask rather than Butler.

      This will add the general framework that will let us add more types of collections later (calibration collections and maybe virtual collections), but we won't actually do that here.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21766 Add per-dataset-type tables to Registry

          • Done
          is contained by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21231 Refactor Registry handling of dataset and associated tables

          • Done
          is duplicated by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-19617 Investigate moving multiple-collection support down to Butler

          • Invalid
          is triggered by

          RFC - An issue whose primary purpose is to advertise an intent and allow stakeholders to comment. RFC-663 Collections in the Gen3 Butler

          • Implemented
          is triggering

          Bug - A problem which impairs or prevents the functions of the product. DM-25016 DM-21724 unpickling error appears again

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-24414 Implement --prune-replaced option in ctrl_mpexec

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22163 Add config writing to PipelineTask execution logic

          • To Do

            Activity

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Andy Salnikov, Jim Bosch, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.