Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17498

Devise interim solution for "expected missing" data products in PipelineTask execution

    Details

    • Templates:
    • Story Points:
      2
    • Team:
      Data Release Production

      Description

      We've just encountered a problem Michelle Gower and I discussed back in the SuperTask WG but haven't yet implemented a solution for: it's totally normal for MakeWarpTask to not write some of its expected outputs because there didn't turn out to be an overlap between an input visit and the requested patch.  That of course makes the as-executed QuantumGraph differ from the predicted one, and that breaks things.

      While we don't yet need a solution that results in an empty/sentinal file being written, we should try to find one that could at least be expanded to do that in the future as that may be useful/necessary for addressing this problem in a Pegasus-based executor.

        Attachments

          Container Issues

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jbosch Jim Bosch
                Watchers:
                Jim Bosch, Nate Lust, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel