Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27916

Improve diagnostics and ease-of-use in ISR PipelineTask connections

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      While debugging some Gen3 CPP pipelines with Meredith Rawls and Colin Slater, I noticed two small aspects of IsrTask that, if fixed, would save future devs from ever repeating that investigation:

      • We should make sure all of the exceptions raised when a configured prerequisite dataset is not present (e.g. "no bias and you asked for bias correction") report both the data ID and the actual bias dataset type.
      • We should turn all of the config options like "biasDataProductName" into properties that forward to the Connection-injected configuration options like "connections.bias".  These were Gen2 versions of something Gen3 standardizes and generalizes, and there's just no reason to allow them to ever be different.  We may also want to deprecate those properties at the same time,

        Attachments

          Issue Links

            Activity

            jbosch Jim Bosch created issue -
            mrawls Meredith Rawls made changes -
            Field Original Value New Value
            Link This issue relates to DM-26971 [ DM-26971 ]
            czw Christopher Waters made changes -
            Epic Link DM-27951 [ 442724 ]
            czw Christopher Waters made changes -
            Team Data Release Production [ 10301 ]
            czw Christopher Waters made changes -
            Epic Link DM-27951 [ 442724 ] DM-29158 [ 458521 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-29158 [ 458521 ] DM-30477 [ 509210 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-30477 [ 509210 ] DM-30539 [ 511197 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-30539 [ 511197 ] DM-30546 [ 511212 ]
            czw Christopher Waters made changes -
            Epic Link DM-30546 [ 511212 ] DM-30554 [ 511220 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-30554 [ 511220 ] DM-32156 [ 779836 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-32156 [ 779836 ] DM-32163 [ 779863 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-32163 [ 779863 ] DM-32170 [ 779886 ]
            czw Christopher Waters made changes -
            Epic Link DM-32170 [ 779886 ] DM-32177 [ 779901 ]

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Christopher Waters, Jim Bosch, Meredith Rawls
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.