Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32199

If submit or prepare, have bps check early that WMS is in environment.

    XMLWordPrintable

    Details

      Description

      This may not be as important once restarts in middle of submission work. But currently if someone forgets to put HTCondor in their environment, it does all the prep work (which can take hours) and then dies. And currently most of that wasted time will have to be repeated for the new run.

      Add a function to the base WMS service class for checking have env correct for that class (currently can be does it just have the right things in the environment, but it could be expanded if there are version restrictions). Because we don't want all plugins to just stop working, have the default behavior in the base class just print a warning message to the log.

      This function should be called prior to prepare and submit. It would be nice to not print the warning message twice, but not worth extra time if have to jump through hoops or rewrite a bunch of code.

      Then add this check to the htcondor plugin (If quick add to Pegasus plugin, but the plugin is probably enough out of date to not run the current default yaml).

      If the right wms environment isn't in place, the submission process should stop before doing anything (no QuantumGraph generation, ...) and halt with appropriate message.

        Attachments

          Activity

          No builds found.
          mgower Michelle Gower created issue -
          Hide
          mgower Michelle Gower added a comment -

          I think that Sergey Padolski could add to this function in the PanDA plugin the check for valid PanDA/IDF credentials. Or could add a separate credentials function check at the same time but make the credentials function check independent of the WMS plugin (e.g., like the clustering algorithm)

          Show
          mgower Michelle Gower added a comment - I think that Sergey Padolski could add to this function in the PanDA plugin the check for valid PanDA/IDF credentials. Or could add a separate credentials function check at the same time but make the credentials function check independent of the WMS plugin (e.g., like the clustering algorithm)
          mgower Michelle Gower made changes -
          Field Original Value New Value
          Assignee Michelle Gower [ mgower ]
          mgower Michelle Gower made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          Hide
          mgower Michelle Gower added a comment -

          The changes probably will not survive the changes for starting the submission process in the middle, but should be good enough in the short term and get folks starting to think about what checks should be done early.

          Show
          mgower Michelle Gower added a comment - The changes probably will not survive the changes for starting the submission process in the middle, but should be good enough in the short term and get folks starting to think about what checks should be done early.
          mgower Michelle Gower made changes -
          Reviewers Mikolaj Kowalik [ mkowalik ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          Hide
          mkowalik Mikolaj Kowalik added a comment -

          The changes can be merged to the main branch.

          Show
          mkowalik Mikolaj Kowalik added a comment - The changes can be merged to the main branch.
          mkowalik Mikolaj Kowalik made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          Hide
          tjenness Tim Jenness added a comment -

          Michelle Gower it looks like this ticket can be closed.

          Show
          tjenness Tim Jenness added a comment - Michelle Gower it looks like this ticket can be closed.
          mgower Michelle Gower made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]
          mgower Michelle Gower made changes -
          Labels gen3-middleware backport-v23 gen3-middleware
          Hide
          mgower Michelle Gower added a comment -

          Based on comments in DM-32830, marking this as backport-approved.

          Show
          mgower Michelle Gower added a comment - Based on comments in DM-32830 , marking this as backport-approved.
          mgower Michelle Gower made changes -
          Labels backport-v23 gen3-middleware backport-approved backport-v23 gen3-middleware
          tjenness Tim Jenness made changes -
          Labels backport-approved backport-v23 gen3-middleware backport-approved backport-done backport-v23 gen3-middleware

            People

            Assignee:
            mgower Michelle Gower
            Reporter:
            mgower Michelle Gower
            Reviewers:
            Mikolaj Kowalik
            Watchers:
            Michelle Gower, Mikolaj Kowalik, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.