Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14358

Enable provenance recording in PipelineTasks

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: butler
    • Labels:
    • Story Points:
      4
    • Team:
      Data Release Production

      Description

      Ensure Quantum ID is included in dataset writes by PipelineTasks.

      Was:

      DM-13452 adds outputs property to Quantum class. This probably needs to be stored in the Registry together with the inputs for provenance tracking.

       

        Attachments

          Issue Links

            Activity

            Hide
            jbosch Jim Bosch added a comment -

            Quantum outputs are already represented in the Registry schema as column in the dataset table, so all that's left to do here is to make sure PipelineTask, executors, and Registry pass that information through when datasets are written.  That in turn requires executors to actually insert Quantum objects into the database prior to calling runQuantum.  I'm changing the ticket title to reflect that.

            Show
            jbosch Jim Bosch added a comment - Quantum outputs are already represented in the Registry schema as column in the dataset table, so all that's left to do here is to make sure PipelineTask, executors, and Registry pass that information through when datasets are written.  That in turn requires executors to actually insert Quantum objects into the database prior to calling runQuantum.  I'm changing the ticket title to reflect that.

              People

              • Assignee:
                Unassigned
                Reporter:
                salnikov Andy Salnikov
                Watchers:
                Andy Salnikov, Jim Bosch
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel