Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13194

standup EUPS_PKGROOT test env

    Details

      Description

      Per email from Tim Jenness:

      Josh,
       
        Robert (copied on email) is experimenting with an eups-based post install hook for the shebang fixing. Can you put the file in the requested place please?
       

      Begin forwarded message:
      From: Robert Lupton the Good <rhl@astro.princeton.edu>

      Subject: Re: [RobertLuptonTheGood/eups] Enable eupspkg to use a sub directory for the build (#124)

      Date: January 5, 2018 at 14:19:19 MST

      To: Tim Jenness <tjenness@lsst.org>

      Can you put this file into the root of the distro?  I.e. directly in
      https://eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6

      It doesn't have to be there (well, it does for now).  I think it works locally (I search local paths before remote to find it, and that's tested).  I could push the code, but I think I'll need to cache the file when pulling from the server and I haven't done that yet.

      R
       

      A test env is needed to avoid development files from being captured in the automatic backups.

        Attachments

          Activity

          Hide
          rhl Robert Lupton added a comment -

          Where does this stand?  Is there a reason why we can't just copy the .py file as originally requested if this is going to take more than a few minutes.

          Show
          rhl Robert Lupton added a comment - Where does this stand?  Is there a reason why we can't just copy the .py file as originally requested if this is going to take more than a few minutes.
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Robert Lupton The same concerns I enumerated last week with doing dev with the production env still apply.

          I started standing up a test env on Friday. This should have taken < 15mins but there appears to have been a change between k8s 1.5.x, the production version when the deployment was written, and (at least) 1.8.x in how persistent volumes on gke/gce are managed. gke no longer supports 1.5.x and the k8s configuration needs to be updated. This is actually a "good thing" in that it no longer requires manual gce disk provisioning. Adapting to the new syntax should be straight forward.

          Show
          jhoblitt Joshua Hoblitt added a comment - Robert Lupton The same concerns I enumerated last week with doing dev with the production env still apply. I started standing up a test env on Friday. This should have taken < 15mins but there appears to have been a change between k8s 1.5.x, the production version when the deployment was written, and (at least) 1.8.x in how persistent volumes on gke/gce are managed. gke no longer supports 1.5.x and the k8s configuration needs to be updated. This is actually a "good thing" in that it no longer requires manual gce disk provisioning. Adapting to the new syntax should be straight forward.
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Robert Lupton A test env is up at https://jhoblitt-dev-eups.lsst.codes/ . It is in the process of copying files from an s3 bucket to a persistent volume mounted in the k8s pod. I'm not sure how long it will take to sync up – the eups distrib repos are over half a TiB. I suggest waiting an hour or so before checking.

          I have copied the provided file into the source s3 bucket.

          $ aws s3 ls s3://jhoblitt-dev-eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6/distribInstallPostHook.py
          2018-01-16 12:32:45       4331 distribInstallPostHook.py
          

          Show
          jhoblitt Joshua Hoblitt added a comment - Robert Lupton A test env is up at https://jhoblitt-dev-eups.lsst.codes/ . It is in the process of copying files from an s3 bucket to a persistent volume mounted in the k8s pod. I'm not sure how long it will take to sync up – the eups distrib repos are over half a TiB. I suggest waiting an hour or so before checking. I have copied the provided file into the source s3 bucket. $ aws s3 ls s3: //jhoblitt-dev-eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6/distribInstallPostHook.py 2018 - 01 - 16 12 : 32 : 45 4331 distribInstallPostHook.py
          Hide
          jhoblitt Joshua Hoblitt added a comment - - edited

          Could one of (Angelo Fausti,Adam Thornton,Jonathan Sick) review this PR (jira is still not picking up PRs) to migrate the eups.lsst.codes deployment to the brave new world of dynamic PVs on gke?

          https://github.com/lsst-sqre/sandbox-eups/pull/12/files

          Show
          jhoblitt Joshua Hoblitt added a comment - - edited Could one of ( Angelo Fausti , Adam Thornton , Jonathan Sick ) review this PR (jira is still not picking up PRs) to migrate the eups.lsst.codes deployment to the brave new world of dynamic PVs on gke? https://github.com/lsst-sqre/sandbox-eups/pull/12/files
          Show
          jhoblitt Joshua Hoblitt added a comment - The requested file is definitely present: https://jhoblitt-dev-eups.lsst.codes/stack/osx/10.9/clang-800.0.42.1/miniconda2-4.3.21-10a4fa6/distribInstallPostHook.py
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Robert Lupton Is the test env still in use or can it be shutdown?

          Show
          jhoblitt Joshua Hoblitt added a comment - Robert Lupton Is the test env still in use or can it be shutdown?
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          Adam Thornton Reviewed / approved the updated k8s configuration on GH. The production deployment now needs to be updated.

          Show
          jhoblitt Joshua Hoblitt added a comment - Adam Thornton Reviewed / approved the updated k8s configuration on GH. The production deployment now needs to be updated.
          Hide
          rhl Robert Lupton added a comment -

          Still in use (please make sure that it's kept up to date with live environment).

           

          Show
          rhl Robert Lupton added a comment - Still in use (please make sure that it's kept up to date with live environment).  
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          [Robert Lupton Is this test env still being actively used?

          Show
          jhoblitt Joshua Hoblitt added a comment - [ Robert Lupton Is this test env still being actively used?
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          The test env has been shutdown.

          Show
          jhoblitt Joshua Hoblitt added a comment - The test env has been shutdown.

            People

            • Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              jhoblitt Joshua Hoblitt
              Reviewers:
              Joshua Hoblitt
              Watchers:
              Adam Thornton, Angelo Fausti, Jonathan Sick, Joshua Hoblitt, Robert Lupton, Tim Jenness
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel