Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-7546

create a shared stack in GPFS for Verification Cluster


    • Templates:
    • Story Points:
    • Epic Link:
    • Sprint:
      DRP F16-4
    • Team:
      Data Release Production


      Analogous to the work of DM-6968 for NFS, we request a shared stack within the GPFS file system for lsst-dev7 and the Verification Cluster (48 nodes, 1152 cores).

      The familiar NFS home directories are available on the front end system lsst-dev7, but are not mounted on the compute nodes of the Verification Cluster. As such, the NFS stack of DM-6968 is not usable for computation on the Verification Cluster.

      Initial testing shows computation against a stack in GPFS can execute at least 300+ simultaneous tasks/pipelines without significant slowdown, suggesting a wide range of work can be performed with a stack in the shared GPFS space on the >~ 1000 cores of the Verification Cluster.

      The suggested location for the GPFS stack is under /software/lsstsw , reachable on lsst-dev7 (i.e., the build of the stack would be done on lsst-dev7, running CentOS 7.2.1511 ).

      The /software space is considered a location where various reference software stacks might be made available to the team.

      In addition to /software/lsstsw , the 'lsstsw' user does have a 'GPFS home' directory /gpfs/fs0/home/lsstsw that could also be used, though the organization offered by /software appears preferable. (The 'lsstsw' user would continue to have a home directory in NFS for the time being, with an eventual transition to that on GPFS. )




            • Assignee:
              swinbank John Swinbank
              gdaues Greg Daues
              Greg Daues
              Greg Daues, John Swinbank
            • Votes:
              0 Vote for this issue
              2 Start watching this issue


              • Created:

                Summary Panel