Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13194

standup EUPS_PKGROOT test env

    Details

      Description

      Per email from Tim Jenness:

      Josh,
       
        Robert (copied on email) is experimenting with an eups-based post install hook for the shebang fixing. Can you put the file in the requested place please?
       

      Begin forwarded message:
      From: Robert Lupton the Good <rhl@astro.princeton.edu>

      Subject: Re: [RobertLuptonTheGood/eups] Enable eupspkg to use a sub directory for the build (#124)

      Date: January 5, 2018 at 14:19:19 MST

      To: Tim Jenness <tjenness@lsst.org>

      Can you put this file into the root of the distro?  I.e. directly in
      https://eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6

      It doesn't have to be there (well, it does for now).  I think it works locally (I search local paths before remote to find it, and that's tested).  I could push the code, but I think I'll need to cache the file when pulling from the server and I haven't done that yet.

      R
       

      A test env is needed to avoid development files from being captured in the automatic backups.

        Attachments

          Activity

          jhoblitt Joshua Hoblitt created issue -
          jhoblitt Joshua Hoblitt made changes -
          Field Original Value New Value
          Epic Link DM-12784 [ 36402 ]
          jhoblitt Joshua Hoblitt made changes -
          Assignee Joshua Hoblitt [ jhoblitt ]
          Hide
          rhl Robert Lupton added a comment -

          Where does this stand?  Is there a reason why we can't just copy the .py file as originally requested if this is going to take more than a few minutes.

          Show
          rhl Robert Lupton added a comment - Where does this stand?  Is there a reason why we can't just copy the .py file as originally requested if this is going to take more than a few minutes.
          jhoblitt Joshua Hoblitt made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Robert Lupton The same concerns I enumerated last week with doing dev with the production env still apply.

          I started standing up a test env on Friday. This should have taken < 15mins but there appears to have been a change between k8s 1.5.x, the production version when the deployment was written, and (at least) 1.8.x in how persistent volumes on gke/gce are managed. gke no longer supports 1.5.x and the k8s configuration needs to be updated. This is actually a "good thing" in that it no longer requires manual gce disk provisioning. Adapting to the new syntax should be straight forward.

          Show
          jhoblitt Joshua Hoblitt added a comment - Robert Lupton The same concerns I enumerated last week with doing dev with the production env still apply. I started standing up a test env on Friday. This should have taken < 15mins but there appears to have been a change between k8s 1.5.x, the production version when the deployment was written, and (at least) 1.8.x in how persistent volumes on gke/gce are managed. gke no longer supports 1.5.x and the k8s configuration needs to be updated. This is actually a "good thing" in that it no longer requires manual gce disk provisioning. Adapting to the new syntax should be straight forward.
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Robert Lupton A test env is up at https://jhoblitt-dev-eups.lsst.codes/ . It is in the process of copying files from an s3 bucket to a persistent volume mounted in the k8s pod. I'm not sure how long it will take to sync up – the eups distrib repos are over half a TiB. I suggest waiting an hour or so before checking.

          I have copied the provided file into the source s3 bucket.

          $ aws s3 ls s3://jhoblitt-dev-eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6/distribInstallPostHook.py
          2018-01-16 12:32:45       4331 distribInstallPostHook.py
          

          Show
          jhoblitt Joshua Hoblitt added a comment - Robert Lupton A test env is up at https://jhoblitt-dev-eups.lsst.codes/ . It is in the process of copying files from an s3 bucket to a persistent volume mounted in the k8s pod. I'm not sure how long it will take to sync up – the eups distrib repos are over half a TiB. I suggest waiting an hour or so before checking. I have copied the provided file into the source s3 bucket. $ aws s3 ls s3: //jhoblitt-dev-eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6/distribInstallPostHook.py 2018 - 01 - 16 12 : 32 : 45 4331 distribInstallPostHook.py
          Hide
          jhoblitt Joshua Hoblitt added a comment - - edited

          Could one of (Angelo Fausti,Adam Thornton,Jonathan Sick) review this PR (jira is still not picking up PRs) to migrate the eups.lsst.codes deployment to the brave new world of dynamic PVs on gke?

          https://github.com/lsst-sqre/sandbox-eups/pull/12/files

          Show
          jhoblitt Joshua Hoblitt added a comment - - edited Could one of ( Angelo Fausti , Adam Thornton , Jonathan Sick ) review this PR (jira is still not picking up PRs) to migrate the eups.lsst.codes deployment to the brave new world of dynamic PVs on gke? https://github.com/lsst-sqre/sandbox-eups/pull/12/files
          jhoblitt Joshua Hoblitt made changes -
          Reviewers Adam Thornton, Angelo Fausti, Jonathan Sick [ athornton, afausti, jsick ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          jhoblitt Joshua Hoblitt made changes -
          Story Points 0.75
          Show
          jhoblitt Joshua Hoblitt added a comment - The requested file is definitely present: https://jhoblitt-dev-eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6/distribInstallPostHook.py
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Robert Lupton Is the test env still in use or can it be shutdown?

          Show
          jhoblitt Joshua Hoblitt added a comment - Robert Lupton Is the test env still in use or can it be shutdown?
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Adam Thornton Reviewed / approved the updated k8s configuration on GH. The production deployment now needs to be updated.

          Show
          jhoblitt Joshua Hoblitt added a comment - Adam Thornton Reviewed / approved the updated k8s configuration on GH. The production deployment now needs to be updated.
          jhoblitt Joshua Hoblitt made changes -
          Status In Review [ 10004 ] In Progress [ 3 ]
          Hide
          rhl Robert Lupton added a comment -

          Still in use (please make sure that it's kept up to date with live environment).

           

          Show
          rhl Robert Lupton added a comment - Still in use (please make sure that it's kept up to date with live environment).  
          jhoblitt Joshua Hoblitt made changes -
          Reviewers Adam Thornton, Angelo Fausti, Jonathan Sick [ athornton, afausti, jsick ] Joshua Hoblitt [ jhoblitt ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          jhoblitt Joshua Hoblitt made changes -
          Epic Link DM-12784 [ 36402 ] DM-13784 [ 39331 ]
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          [Robert Lupton Is this test env still being actively used?

          Show
          jhoblitt Joshua Hoblitt added a comment - [ Robert Lupton Is this test env still being actively used?
          jhoblitt Joshua Hoblitt made changes -
          Risk Score 0
          jhoblitt Joshua Hoblitt made changes -
          Epic Link DM-13784 [ 39331 ] DM-14567 [ 94448 ]
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          The test env has been shutdown.

          Show
          jhoblitt Joshua Hoblitt added a comment - The test env has been shutdown.
          jhoblitt Joshua Hoblitt made changes -
          Resolution Done [ 10000 ]
          Status In Review [ 10004 ] Done [ 10002 ]

            People

            • Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              jhoblitt Joshua Hoblitt
              Reviewers:
              Joshua Hoblitt
              Watchers:
              Adam Thornton, Angelo Fausti, Jonathan Sick, Joshua Hoblitt, Robert Lupton, Tim Jenness
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel