Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17498

Devise interim solution for "expected missing" data products in PipelineTask execution

    Details

    • Templates:
    • Story Points:
      2
    • Team:
      Data Release Production

      Description

      We've just encountered a problem Michelle Gower and I discussed back in the SuperTask WG but haven't yet implemented a solution for: it's totally normal for MakeWarpTask to not write some of its expected outputs because there didn't turn out to be an overlap between an input visit and the requested patch.  That of course makes the as-executed QuantumGraph differ from the predicted one, and that breaks things.

      While we don't yet need a solution that results in an empty/sentinal file being written, we should try to find one that could at least be expanded to do that in the future as that may be useful/necessary for addressing this problem in a Pegasus-based executor.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch, Nate Lust, Yusra AlSayyad
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel