Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10990

Handling large worfklows

    XMLWordPrintable

    Details

      Description

      During the planning stage, Pegasus traverses the graphs multiple times, and some of the graph transforms can be slow depending on if the graph is large. Pegasus developers suggest using hierarchical workflows in such cases. The goal is to:

      • how those workflows work in practice,
      • find out if they allow for creating dynamical workflows.

        Attachments

          Activity

          Hide
          Permalink
          mkowalik Mikolaj Kowalik added a comment -

          I went through available online materials (documentation, presentations, and workflow examples) focusing on hierarchical workflows. I also created and run successfully my own hierarchical workflow.

          Show
          mkowalik Mikolaj Kowalik added a comment - I went through available online materials (documentation, presentations, and workflow examples) focusing on hierarchical workflows. I also created and run successfully my own hierarchical workflow.

            People

            Assignee:
            mkowalik Mikolaj Kowalik
            Reporter:
            mkowalik Mikolaj Kowalik
            Watchers:
            Mikolaj Kowalik
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.