Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-5178

lsstsw deploy on OS X fails in miniconda install

    XMLWordPrintable

    Details

      Description

      Testing the fixes for the deploy script in DM-4359 it seems that the part of the script installing miniconda no longer works on OS X because the list of packages to be installed has been derived from a Linux system and not all the Linux packages have OS X equivalents. There needs to be a per-OS list of packages. The default OS X list seems to be:

      # This file may be used to create an environment using:
      # $ conda create --name <env> --file <this file>
      # platform: osx-64
      astropy=1.1.1=np110py27_0
      conda=3.19.1=py27_0
      conda-env=2.4.5=py27_0
      cycler=0.9.0=py27_0
      cython=0.23.4=py27_1
      freetype=2.5.5=0
      libpng=1.6.17=0
      matplotlib=1.5.1=np110py27_0
      nomkl=1.0=0
      numpy=1.10.4=py27_nomkl_0
      openssl=1.0.2f=0
      pandas=0.17.1=np110py27_0
      pip=8.0.2=py27_0
      pycosat=0.6.1=py27_0
      pycrypto=2.6.1=py27_0
      pyparsing=2.0.3=py27_0
      pyqt=4.11.4=py27_1
      python=2.7.11=0
      python-dateutil=2.4.2=py27_0
      pytz=2015.7=py27_0
      pyyaml=3.11=py27_1
      qt=4.8.7=1
      readline=6.2=2
      requests=2.9.1=py27_0
      scipy=0.17.0=np110py27_nomkl_0
      setuptools=19.6.2=py27_0
      sip=4.16.9=py27_0
      six=1.10.0=py27_0
      sqlalchemy=1.0.11=py27_0
      sqlite=3.9.2=0
      tk=8.5.18=0
      wheel=0.29.0=py27_0
      yaml=0.1.6=0
      zlib=1.2.8=0
      

        Attachments

          Issue Links

            Activity

            tjenness Tim Jenness created issue -
            tjenness Tim Jenness made changes -
            Field Original Value New Value
            Link This issue is triggered by DM-5105 [ DM-5105 ]
            tjenness Tim Jenness made changes -
            Link This issue blocks DM-4359 [ DM-4359 ]
            tjenness Tim Jenness made changes -
            Assignee Frossie Economou [ frossie ] Joshua Hoblitt [ jhoblitt ]
            tjenness Tim Jenness made changes -
            Watchers Tim Jenness [ Tim Jenness ] Jonathan Sick, Russell Owen, Tim Jenness [ Jonathan Sick, Russell Owen, Tim Jenness ]
            jhoblitt Joshua Hoblitt made changes -
            Link This issue relates to DM-4345 [ DM-4345 ]
            tjenness Tim Jenness made changes -
            Link This issue is duplicated by DM-5157 [ DM-5157 ]
            tjenness Tim Jenness made changes -
            Link This issue blocks DM-5179 [ DM-5179 ]
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            My inclination is to fix this correctly and have a separate linux/osx conda package lists. Could someone provide a package list from OSX after doing a -b install?

            Show
            jhoblitt Joshua Hoblitt added a comment - My inclination is to fix this correctly and have a separate linux/osx conda package lists. Could someone provide a package list from OSX after doing a -b install?
            Hide
            tjenness Tim Jenness added a comment -

            That list is on this ticket as well as on DM-5157

            Show
            tjenness Tim Jenness added a comment - That list is on this ticket as well as on DM-5157
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            Err, I thought that was the linux list for some reason... thank you.

            Show
            jhoblitt Joshua Hoblitt added a comment - Err, I thought that was the linux list for some reason... thank you.
            jhoblitt Joshua Hoblitt made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Hide
            darko Darko Jevremovic added a comment -

            Is there any timeline for resolution of this. I have a new student who after updating her OSX is stuck at instalation of miniconda. Or is there are quick workaround?
            Thx.

            Show
            darko Darko Jevremovic added a comment - Is there any timeline for resolution of this. I have a new student who after updating her OSX is stuck at instalation of miniconda. Or is there are quick workaround? Thx.
            Hide
            tjenness Tim Jenness added a comment -

            Use bin/deploy -b for now.

            Show
            tjenness Tim Jenness added a comment - Use bin/deploy -b for now.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            My intent is for this to be resolved this week.

            Show
            jhoblitt Joshua Hoblitt added a comment - My intent is for this to be resolved this week.
            tjenness Tim Jenness made changes -
            Link This issue is duplicated by DM-5411 [ DM-5411 ]
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            After quite a bit of fiddling, I seem to have gotten OSX working under travis. This required setting up the travis matrix with multiple languages, which the docs say is unsupported and the linter warns on, but this seems to be the only to be able to use the pre-canned python versions on linux combined with a vanilla env on osx (travis does not support python on OSX). The OSX build seems to fail intermittently running rebuild due to the 10 minute travis console output timeout. I have marked the OSX builds as allowed to fail due to the random timeouts and the long wait for OSX workers to start.

            Show
            jhoblitt Joshua Hoblitt added a comment - After quite a bit of fiddling, I seem to have gotten OSX working under travis. This required setting up the travis matrix with multiple languages, which the docs say is unsupported and the linter warns on, but this seems to be the only to be able to use the pre-canned python versions on linux combined with a vanilla env on osx (travis does not support python on OSX). The OSX build seems to fail intermittently running rebuild due to the 10 minute travis console output timeout. I have marked the OSX builds as allowed to fail due to the random timeouts and the long wait for OSX workers to start.
            Hide
            jhoblitt Joshua Hoblitt added a comment -

            Merged without review as the change is trivial (and was blocking DM-5179).

            Show
            jhoblitt Joshua Hoblitt added a comment - Merged without review as the change is trivial (and was blocking DM-5179 ).
            jhoblitt Joshua Hoblitt made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]
            jhoblitt Joshua Hoblitt made changes -
            Epic Link DM-4653 [ 21896 ]
            jhoblitt Joshua Hoblitt made changes -
            Story Points 0.667
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-3889 [ DM-3889 ]

              People

              Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              tjenness Tim Jenness
              Watchers:
              Darko Jevremovic, Jonathan Sick, Joshua Hoblitt, Russell Owen, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: