Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10991

Optimizing workflows

    Details

      Description

      There are always overheads when scheduling jobs, commonly related to scheduling, data transfers, state notifications, and task book keeping. These overheads can be very noticeable for short jobs. The solution recommended by Pegasus team to minimize those overhead is to use task clustering. The goal is to explore this mechanism and access if it is flexible enough to address common operational requirements.

        Attachments

          Activity

          mkowalik Mikolaj Kowalik created issue -
          mkowalik Mikolaj Kowalik made changes -
          Field Original Value New Value
          Epic Link DM-10700 [ 32653 ]
          mkowalik Mikolaj Kowalik made changes -
          Summary Optimiazing workflows Optimazing workflows
          mkowalik Mikolaj Kowalik made changes -
          Summary Optimazing workflows Optimizing workflows
          mkowalik Mikolaj Kowalik made changes -
          Description There are always overheads when scheduling jobs, commonly related to scheduling, data transfers, state notifications, and task book keeping. These overheads can be very noticeable for short jobs. The solution recommended by _Pegasus_ team to minimize those overhead is to use *task clustering*. The goal is to explore this mechanism and access if it is flexible enough to address known requirements. There are always overheads when scheduling jobs, commonly related to scheduling, data transfers, state notifications, and task book keeping. These overheads can be very noticeable for short jobs. The solution recommended by _Pegasus_ team to minimize those overhead is to use *task clustering*. The goal is to explore this mechanism and access if it is flexible enough to address common operational requirements.
          mkowalik Mikolaj Kowalik made changes -
          Resolution Done [ 10000 ]
          Status To Do [ 10001 ] Done [ 10002 ]
          frossie Frossie Economou made changes -
          Team Process Middleware [ 10206 ] Data Facility [ 12219 ]

            People

            • Assignee:
              mkowalik Mikolaj Kowalik
              Reporter:
              mkowalik Mikolaj Kowalik
              Watchers:
              Mikolaj Kowalik
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel