Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15130

Add LSST shared stacks on tigercpu & tigergpu login nodes (at Princeton)

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Team:
      Data Release Production

      Description

      From Bill Wisher at Princeton: "The new tiger has two login nodes.  #1 is tigergpu, an Intel Broadwell server.  And #2, tigercpu, an Intel Skylake server."  So I believe they will each need their own builds, please add them.

        Attachments

          Issue Links

            Activity

            No builds found.
            lauren Lauren MacArthur created issue -
            lauren Lauren MacArthur made changes -
            Field Original Value New Value
            Link This issue relates to DM-14571 [ DM-14571 ]
            lauren Lauren MacArthur made changes -
            Risk Score 0
            Hide
            swinbank John Swinbank added a comment -

            Will you actually want anything on tigergpu? We don't use GPUs.

            Beyond that, unless the hardware is very exotic, the only thing that matters is probably the operating system. I think they all have access to /tigress, right? Can you try simply running the Perseus-built stack on new-Tiger? I think that'll probably Just Work.

            Show
            swinbank John Swinbank added a comment - Will you actually want anything on tigergpu ? We don't use GPUs. Beyond that, unless the hardware is very exotic, the only thing that matters is probably the operating system. I think they all have access to /tigress , right? Can you try simply running the Perseus-built stack on new-Tiger? I think that'll probably Just Work.
            Hide
            lauren Lauren MacArthur added a comment -

            Ah, you are correct:

            [lam3@tigercpu ~]$ module load rh/devtoolset/6
            [lam3@tigercpu ~]$ source /tigress/HSC/LSST/stack_perseus/loadLSST.bash
            Note: use devtoolset-6 in conjunction with this stack.
            [lam3@tigercpu ~]$ setup lsst_distrib
            [lam3@tigercpu ~]$ eups list -s lsst_distrib
             16.0+11 current w_2018_28 setup
            

            And a trial processCcd.py ran fine.

            As for tigergpu...I have no idea if we'll ever want to use it, but the above worked there too, so the point is moot . So I suppose this can be marked invalid (or altered to just make some updates to the documentation here)?

            Show
            lauren Lauren MacArthur added a comment - Ah, you are correct: [lam3@tigercpu ~]$ module load rh/devtoolset/6 [lam3@tigercpu ~]$ source /tigress/HSC/LSST/stack_perseus/loadLSST.bash Note: use devtoolset-6 in conjunction with this stack. [lam3@tigercpu ~]$ setup lsst_distrib [lam3@tigercpu ~]$ eups list -s lsst_distrib 16.0+11 current w_2018_28 setup And a trial processCcd.py ran fine. As for tigergpu ...I have no idea if we'll ever want to use it, but the above worked there too, so the point is moot . So I suppose this can be marked invalid (or altered to just make some updates to the documentation here )?
            Hide
            swinbank John Swinbank added a comment -

            I like the idea of this being a doc update.

            Show
            swinbank John Swinbank added a comment - I like the idea of this being a doc update.
            Hide
            swinbank John Swinbank added a comment -

            Hey Lauren, do you mind taking a look at https://github.com/lsst-dm/dm_dev_guide/pull/249?

            I'm deliberately shortening the instructions here to just the essentials, in part because I'm no longer au fait with what's actually being used by the group in Princeton. If there's more that you think should be added, perhaps you could suggest some text?

            Show
            swinbank John Swinbank added a comment - Hey Lauren, do you mind taking a look at https://github.com/lsst-dm/dm_dev_guide/pull/249? I'm deliberately shortening the instructions here to just the essentials, in part because I'm no longer au fait with what's actually being used by the group in Princeton. If there's more that you think should be added, perhaps you could suggest some text?
            swinbank John Swinbank made changes -
            Reviewers Lauren MacArthur [ lauren ]
            Status To Do [ 10001 ] In Review [ 10004 ]
            Hide
            swinbank John Swinbank added a comment -

            Hey Lauren MacArthur — gentle reminder!

            Show
            swinbank John Swinbank added a comment - Hey Lauren MacArthur — gentle reminder!
            Hide
            lauren Lauren MacArthur added a comment - - edited

            So sorry this slipped off my radar!  The text all looks good to me, but I just tried setting up the stacks and they are giving me:

             

            lam3@tiger2-sumire:~ $ eups list -s lsst_distrib
             16.0+36 current w_2018_33 setup
            lam3@perseus:~ $ eups list -s lsst_distrib
             16.0+36 current w_2018_33 setup
            

             

            whereas lsst-dev has:

             

            lauren@lsst-dev01:~ $ eups list -s lsst_distrib
             16.0+41 current w_2018_34 setup 
            

            Is the auto-update not working properly?

            Show
            lauren Lauren MacArthur added a comment - - edited So sorry this slipped off my radar!  The text all looks good to me, but I just tried setting up the stacks and they are giving me:   lam3 @tiger2 -sumire:~ $ eups list -s lsst_distrib 16.0 + 36 current w_2018_33 setup lam3 @perseus :~ $ eups list -s lsst_distrib 16.0 + 36 current w_2018_33 setup   whereas lsst-dev has:   lauren @lsst -dev01:~ $ eups list -s lsst_distrib 16.0 + 41 current w_2018_34 setup  Is the auto-update not working properly?
            Hide
            swinbank John Swinbank added a comment -

            The build on new-Tiger is failing with

            $ cat /tigress/HSC/LSST/stack3_perseus_20171107/stack/miniconda3-4.3.21-10a4fa6/EupsBuildDir/Linux64/daf_persistence-16.0-3-g3806c63+6/daf_persistence-16.0-3-g3806c63+6/tests/.tests/PropertySet_2.failed 
            tests/PropertySet_2
             
            Running 1 test case...
             
            *** No errors detected
            

            which seems less than entirely helpful, but it doesn't seem to be a problem with these docs.

            I propose to merge the text on this ticket and file a new one to investigate the build failure. Ok with you?

            Show
            swinbank John Swinbank added a comment - The build on new-Tiger is failing with $ cat /tigress/HSC/LSST/stack3_perseus_20171107/stack/miniconda3-4.3.21-10a4fa6/EupsBuildDir/Linux64/daf_persistence-16.0-3-g3806c63+6/daf_persistence-16.0-3-g3806c63+6/tests/.tests/PropertySet_2.failed tests/PropertySet_2   Running 1 test case...   *** No errors detected which seems less than entirely helpful, but it doesn't seem to be a problem with these docs. I propose to merge the text on this ticket and file a new one to investigate the build failure. Ok with you?
            Hide
            lauren Lauren MacArthur added a comment -

            A-ok with me.

            Show
            lauren Lauren MacArthur added a comment - A-ok with me.
            lauren Lauren MacArthur made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            Hide
            swinbank John Swinbank added a comment -

            Thanks Lauren; merged. Eli Rykoff will be glad to hear that the instructions are now not obviously incorrect!

            Show
            swinbank John Swinbank added a comment - Thanks Lauren; merged. Eli Rykoff will be glad to hear that the instructions are now not obviously incorrect!
            swinbank John Swinbank made changes -
            Link This issue relates to DM-15593 [ DM-15593 ]
            Hide
            swinbank John Swinbank added a comment -

            Follow-up ticket for build failures in DM-15593.

            Show
            swinbank John Swinbank added a comment - Follow-up ticket for build failures in DM-15593 .
            swinbank John Swinbank made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]

              People

              Assignee:
              swinbank John Swinbank
              Reporter:
              lauren Lauren MacArthur
              Reviewers:
              Lauren MacArthur
              Watchers:
              John Swinbank, Lauren MacArthur, Paul Price, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.