Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22162

Add metadata writing to PipelineTask execution logic

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Sprint:
      DB_F19_10
    • Team:
      Data Access and Database

      Description

      PipelineTask execution should automatically write a metadata dataset for each Quantum.  We want that to appear in the QuantumGraph as well, so downstream PipelineTasks can use these as inputs.

       

        Attachments

          Issue Links

            Activity

            Hide
            nlust Nate Lust added a comment -

            I have no problem reviewing this one and the one you sent me if no one else has a problem, and or, would prefer to do one.

            Show
            nlust Nate Lust added a comment - I have no problem reviewing this one and the one you sent me if no one else has a problem, and or, would prefer to do one.
            Hide
            nlust Nate Lust added a comment -

            Jim Bosch The only thing I think that might be an issues with using the _DefaultName instead of the label is that if there are two tasks in the same pipeline, there would be an error building the graph as two tasks would produce the same pipeline. Now maybe we are fine with this, but it is worth considering for the sake of error message and or configuration

            Show
            nlust Nate Lust added a comment - Jim Bosch The only thing I think that might be an issues with using the _DefaultName instead of the label is that if there are two tasks in the same pipeline, there would be an error building the graph as two tasks would produce the same pipeline. Now maybe we are fine with this, but it is worth considering for the sake of error message and or configuration
            Hide
            jbosch Jim Bosch added a comment -

            I am certainly not suggesting that we use the _DefaultName instead of the label - just that we make the default value for the label (either by code or by convention) the same as _DefaultName.

            Show
            jbosch Jim Bosch added a comment - I am certainly not suggesting that we use the _DefaultName instead of the label - just that we make the default value for the label (either by code or by convention) the same as _DefaultName.
            Hide
            nlust Nate Lust added a comment -

            Two small points, but over all looks good. I think Jim's point is good, but should go into a document on conventions for pipelines

            Show
            nlust Nate Lust added a comment - Two small points, but over all looks good. I think Jim's point is good, but should go into a document on conventions for pipelines
            Hide
            salnikov Andy Salnikov added a comment -

            Nate Lust, thanks for review and suggestions! I merged pipe_base and ctrl_mpexec. Krzysztof Findeisen, I presume that review of verify PR is going to happen on your DM-21911 ticket, so I'm closing this ticket.

            Show
            salnikov Andy Salnikov added a comment - Nate Lust , thanks for review and suggestions! I merged pipe_base and ctrl_mpexec . Krzysztof Findeisen , I presume that review of verify PR is going to happen on your DM-21911 ticket, so I'm closing this ticket.

              People

              Assignee:
              salnikov Andy Salnikov
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Nate Lust
              Watchers:
              Andy Salnikov, Christopher Waters, Jim Bosch, Krzysztof Findeisen, Nate Lust, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  CI Builds

                  No builds found.