Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10990

Handling large worfklows

    Details

      Description

      During the planning stage, Pegasus traverses the graphs multiple times, and some of the graph transforms can be slow depending on if the graph is large. Pegasus developers suggest using hierarchical workflows in such cases. The goal is to:

      • how those workflows work in practice,
      • find out if they allow for creating dynamical workflows.

        Attachments

          Activity

          Hide
          mkowalik Mikolaj Kowalik added a comment -

          I went through available online materials (documentation, presentations, and workflow examples) focusing on hierarchical workflows. I also created and run successfully my own hierarchical workflow.

          Show
          mkowalik Mikolaj Kowalik added a comment - I went through available online materials (documentation, presentations, and workflow examples) focusing on hierarchical workflows. I also created and run successfully my own hierarchical workflow.

            People

            • Assignee:
              mkowalik Mikolaj Kowalik
              Reporter:
              mkowalik Mikolaj Kowalik
              Watchers:
              Mikolaj Kowalik
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel