Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11753

Analyze Pegasus' planner performance

    Details

      Description

      During planning stage Pegasus load and parses the DAG representing the workflow multiple times. The goal is to estimate how time of the planning depends on the size of the workflow.

        Attachments

          Activity

          Hide
          mkowalik Mikolaj Kowalik added a comment - - edited

          I wrote a simple random DAG generator and use it to create workflows of different sizes. For each investigated size I generated 10 random DAGs, used Pegasus planner to create concrete workflows, and took an average as the estimate of the planning time. The results are presented on the attached figure.

          It must be emphasized that those times are for randomly generated workflows and planning times for actual LSST pipelines may differ.

          Show
          mkowalik Mikolaj Kowalik added a comment - - edited I wrote a simple random DAG generator and use it to create workflows of different sizes. For each investigated size I generated 10 random DAGs, used Pegasus planner to create concrete workflows, and took an average as the estimate of the planning time. The results are presented on the attached figure. It must be emphasized that those times are for randomly generated workflows and planning times for actual LSST pipelines may differ.

            People

            • Assignee:
              mkowalik Mikolaj Kowalik
              Reporter:
              mkowalik Mikolaj Kowalik
              Watchers:
              Mikolaj Kowalik
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel