Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11753

Analyze Pegasus' planner performance

    XMLWordPrintable

    Details

      Description

      During planning stage Pegasus load and parses the DAG representing the workflow multiple times. The goal is to estimate how time of the planning depends on the size of the workflow.

        Attachments

          Activity

          Hide
          Permalink
          mkowalik Mikolaj Kowalik added a comment - - edited

          I wrote a simple random DAG generator and use it to create workflows of different sizes. For each investigated size I generated 10 random DAGs, used Pegasus planner to create concrete workflows, and took an average as the estimate of the planning time. The results are presented on the attached figure.

          It must be emphasized that those times are for randomly generated workflows and planning times for actual LSST pipelines may differ.

          Show
          mkowalik Mikolaj Kowalik added a comment - - edited I wrote a simple random DAG generator and use it to create workflows of different sizes. For each investigated size I generated 10 random DAGs, used Pegasus planner to create concrete workflows, and took an average as the estimate of the planning time. The results are presented on the attached figure. It must be emphasized that those times are for randomly generated workflows and planning times for actual LSST pipelines may differ.

            People

            Assignee:
            mkowalik Mikolaj Kowalik
            Reporter:
            mkowalik Mikolaj Kowalik
            Watchers:
            Mikolaj Kowalik
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.