Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-8633

Prototype a wrapper generating DAXs for sequential workflows

    Details

      Description

      Pegasus' abstract workflows (DAXs) are specified in XML format and it provides a dedicated API for their generation. The goal is to write a prototype of a wrapper which will automate creating DAXs for multi-component, though sequential, workflows. As a starting point, a sequential workflow representing algorithmic components of processCcd will be used.

        Attachments

          Activity

          mkowalik Mikolaj Kowalik created issue -
          mkowalik Mikolaj Kowalik made changes -
          Field Original Value New Value
          Epic Link DM-8332 [ 27861 ]
          mkowalik Mikolaj Kowalik made changes -
          Labels Batch_Production_Services
          mkowalik Mikolaj Kowalik made changes -
          Description Pegasus' abstract workflows (DAXs) are specified in XML format and it provides a dedicated API for their generation. The goal is to write a prototype of a wrapper which will automate creating DAXs for multi-component workflows. As a starting point, a sequential workflow representing algorithmic components of {{processCcd}} will be used. Pegasus' abstract workflows (DAXs) are specified in XML format and it provides a dedicated API for their generation. The goal is to write a prototype of a wrapper which will automate creating DAXs for multi-component, though sequential, workflows. As a starting point, a sequential workflow representing algorithmic components of {{processCcd}} will be used.
          Summary Prototype a wrapper generating DAXs for multi-component workflows Prototype a wrapper generating DAXs for sequnetial workflows
          mkowalik Mikolaj Kowalik made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          plutchak Joel Plutchak (Inactive) made changes -
          Summary Prototype a wrapper generating DAXs for sequnetial workflows Prototype a wrapper generating DAXs for sequential workflows
          Hide
          mkowalik Mikolaj Kowalik added a comment -

          Instead of processCcd I modified a simplified workflow prepared by Hsin-Fang Chiang (see DM-9092) in a first attempt to decouple specifying the workflow from creating the DAX representing it. The code can be found here.

          Though I did not achieve a complete separation yet, I made "demarcation line" more visible and e.g. plugging in Executor to run workflow tasks was relatively straightforward.

          Show
          mkowalik Mikolaj Kowalik added a comment - Instead of processCcd I modified a simplified workflow prepared by Hsin-Fang Chiang (see DM-9092 ) in a first attempt to decouple specifying the workflow from creating the DAX representing it. The code can be found here . Though I did not achieve a complete separation yet, I made "demarcation line" more visible and e.g. plugging in Executor to run workflow tasks was relatively straightforward.
          mkowalik Mikolaj Kowalik made changes -
          Resolution Done [ 10000 ]
          Status In Progress [ 3 ] Done [ 10002 ]
          frossie Frossie Economou made changes -
          Team Process Middleware [ 10206 ] Data Facility [ 12219 ]

            People

            • Assignee:
              mkowalik Mikolaj Kowalik
              Reporter:
              mkowalik Mikolaj Kowalik
              Watchers:
              Mikolaj Kowalik
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel