Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-744

PanDA for IDF execution

    XMLWordPrintable

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:
      None

      Description

      RTN-013 describes a path for PanDA in the near term. This RFC is to publicise that fact and allow for comment on panda as a longer term solution.

      From RTN-013:
      We need a workflow system and production tools which can process DESC DC2 for DP0.2.
      For PREOPS we should focus on PanDA in the near term  This is separate from the construction side’s HSC reprocessing at NCSA for development needs. The construction team at NCSA can continue to use HTCondor-based BPS for the biweekly HSC reprocessing at NCSA.

        Attachments

          Issue Links

            Activity

            Hide
            tjenness Tim Jenness added a comment -

            My understanding for this evaluation is that:

            1. We are using an Oracle database that is outside of the IDF and not under Rubin control.
            2. We are not integrating PanDA auth into the standard Rubin science platform auth system.
            3. Brookhaven are supporting the PanDA deployment on IDF.

            I have heard talk that PanDA is a bit of a pain to administer which is why I want to be sure that Brookhaven are committing to do that support for the lifetime of the survey.

            I'm happy for us to commit to PanDA for DP0.2 and re-evaluate. I am confident that other solutions would work as a back up but hope that the PanDA "added value" is compelling. The Oracle situation worries me in the long term but in some sense that is Richard Dubois's problem if SLAC are willing to support Oracle and also aren't charging the project for it.

            Show
            tjenness Tim Jenness added a comment - My understanding for this evaluation is that: We are using an Oracle database that is outside of the IDF and not under Rubin control. We are not integrating PanDA auth into the standard Rubin science platform auth system. Brookhaven are supporting the PanDA deployment on IDF. I have heard talk that PanDA is a bit of a pain to administer which is why I want to be sure that Brookhaven are committing to do that support for the lifetime of the survey. I'm happy for us to commit to PanDA for DP0.2 and re-evaluate. I am confident that other solutions would work as a back up but hope that the PanDA "added value" is compelling. The Oracle situation worries me in the long term but in some sense that is Richard Dubois 's problem if SLAC are willing to support Oracle and also aren't charging the project for it.
            Hide
            richard Richard Dubois added a comment -

            Indeed we are expecting BNL staff to be part of the operations team long term. We were given assurances that maintenance of PanDA, once installed, is not much effort, and that it can installed at not-CERN and does not require Oracle. They do find that Oracle brings some good properties. SLAC has a site licence for Oracle, so as long as there are no unusual features outside our licence, we should be ok.   

            Show
            richard Richard Dubois added a comment - Indeed we are expecting BNL staff to be part of the operations team long term. We were given assurances that maintenance of PanDA, once installed, is not much effort, and that it can installed at not-CERN and does not require Oracle. They do find that Oracle brings some good properties. SLAC has a site licence for Oracle, so as long as there are no unusual features outside our licence, we should be ok.   
            Hide
            womullan Wil O'Mullane added a comment -

            A few comments from BNL in email dealt with on the RFC branch.

            Show
            womullan Wil O'Mullane added a comment - A few comments from BNL in email dealt with on the RFC branch.

              People

              Assignee:
              womullan Wil O'Mullane
              Reporter:
              womullan Wil O'Mullane
              Watchers:
              Fabio Hernandez, Hsin-Fang Chiang, Kenneth Herner, Kian-Tat Lim, Richard Dubois, Sergey Padolski, Tim Jenness, Wil O'Mullane
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Planned End:

                  Jenkins

                  No builds found.