Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23722

Validate dataset type definitions in pipeline task connections

    Details

    • Templates:
    • Story Points:
      1
    • Team:
      Architecture
    • Urgent?:
      No

      Description

      In debugging DM-22655 we realized again that the dataset type definitions for input datasets in pipeline task connectors are not validated against dataset type definitions already understood by the registry. This led to a strange bug where cpBias had a ExposureF when the file was ingested but the isrTask definition said it was an ImageF. This led to the pipeline creating a DatasetType object that was at odds with the registry definition and caused an error on get.

      At the very least we should warn if there is an inconsistency between the two when the pipeline runs.

        Attachments

          Activity

            People

            • Assignee:
              tjenness Tim Jenness
              Reporter:
              tjenness Tim Jenness
              Reviewers:
              Andy Salnikov
              Watchers:
              Andy Salnikov, Gabor Kovacs, Jim Bosch, John Parejko, Krzysztof Findeisen, Tim Jenness
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel