Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15558

re-enable osx tarball builds

    XMLWordPrintable

    Details

      Description

      EUPS binary/tarball builds on osx were disabled many weeks ago due to strange problems with eups https downloads from eups.lsst.codes hanging.  Since that time, the sqre osx environment has been "white-listed" with the NOAO traffic mangler – it needs to be determined if this has resolved the problem and if not, the root cause needs to be identified.

        Attachments

          Issue Links

          is triggering

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15674 provision additional jenkins osx 10.12 build nodes

          • Done
          mitigates

          Improvement - An improvement or enhancement to an existing feature or task. DM-14013 allow manual config of newinstall.sh platform/compiler strings

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            jhoblitt Joshua Hoblitt added a comment - - edited

            The d.2018.08.28 nightly failed trying to build astshim on osx:

            c++ -o python/astshim/detail/testUtils.so -bundle -F/ -undefined suppress -flat_namespace -headerpad_max_install_names python/astshim/detail/testUtils.os -Llib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/stack/miniconda3-4.5.4-fcd27eb/DarwinX86/starlink_ast/lsst-dev-gd6cc4e835a/lib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/stack/miniconda3-4.5.4-fcd27eb/DarwinX86/fftw/3.3.4.lsst2/lib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/stack/miniconda3-4.5.4-fcd27eb/DarwinX86/boost/1.68/lib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/python/miniconda3-4.5.4/envs/lsst-scipipe-fcd27eb/lib/python3.6/config-3.6m-darwin/ -lastshim -last -last_pal -last_grf_2.0 -last_grf_3.2 -last_grf_5.6 -last_grf3d -last_pass2 -last_err -lm -lfftw3f -lfftw3 -lpthread -ldl -lpython3.6m
            		 
             
            		 
            error: Unknown attribute kind (52) (Producer: 'LLVM4.0.1' Reader: 'LLVM APPLE_1_800.0.42.1_0')
            		 
             
            		 
            clang: error: linker command failed with exit code 1 (use -v to see invocation)
            		 
             
            		 
            scons: *** [python/astshim/detail/testUtils.so] Error 1
            		 
             
            		 
            scons: building terminated because of errors.
            		 
             
            		 
            + exit -4

            Modifications have been merged to allow the osx tarball build to run on osx-10.12 (instead of osx-10.11) and a test build has made it past astshim:

            https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3220/pipeline

            Show
            jhoblitt Joshua Hoblitt added a comment - - edited The d.2018.08.28 nightly failed trying to build astshim on osx: c++ -o python/astshim/detail/testUtils.so -bundle -F/ -undefined suppress -flat_namespace -headerpad_max_install_names python/astshim/detail/testUtils.os -Llib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/stack/miniconda3- 4.5 . 4 -fcd27eb/DarwinX86/starlink_ast/lsst-dev-gd6cc4e835a/lib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/stack/miniconda3- 4.5 . 4 -fcd27eb/DarwinX86/fftw/ 3.3 . 4 .lsst2/lib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/stack/miniconda3- 4.5 . 4 -fcd27eb/DarwinX86/boost/ 1.68 /lib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/python/miniconda3- 4.5 . 4 /envs/lsst-scipipe-fcd27eb/lib/python3. 6 /config- 3 .6m-darwin/ -lastshim -last -last_pal -last_grf_2. 0 -last_grf_3. 2 -last_grf_5. 6 -last_grf3d -last_pass2 -last_err -lm -lfftw3f -lfftw3 -lpthread -ldl -lpython3.6m   error: Unknown attribute kind ( 52 ) (Producer: 'LLVM4.0.1' Reader: 'LLVM APPLE_1_800.0.42.1_0' )   clang: error: linker command failed with exit code 1 (use -v to see invocation)   scons: *** [python/astshim/detail/testUtils.so] Error 1   scons: building terminated because of errors.   + exit - 4 https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3216/pipeline/ https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3217/pipeline/ https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3217/pipeline/ Modifications have been merged to allow the osx tarball build to run on osx-10.12 (instead of osx-10.11 ) and a test build has made it past astshim : https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3220/pipeline
            Hide
            Permalink
            jhoblitt Joshua Hoblitt added a comment -

            The astshim failure was non-reproducible on osx 10.12 – it isn't clear if this is due to the compiler or something else. Anyways, we were overdue to drop 10.11 anyways – so jenkins and newinstall.sh have been updated to to switch to building only on osx 10.12 / changing the eups distrib tarball compiler string for osx to clang-802.0.42.

            Show
            jhoblitt Joshua Hoblitt added a comment - The astshim failure was non-reproducible on osx 10.12 – it isn't clear if this is due to the compiler or something else. Anyways, we were overdue to drop 10.11 anyways – so jenkins and newinstall.sh have been updated to to switch to building only on osx 10.12 / changing the eups distrib tarball compiler string for osx to clang-802.0.42 .
            Hide
            Permalink
            ktl Kian-Tat Lim added a comment -

            Please announce any new eups.lsst.codes binary distribution URLs widely (e.g. in the Community DM Notifications category and in the Slack #dm channel).

            Show
            ktl Kian-Tat Lim added a comment - Please announce any new eups.lsst.codes binary distribution URLs widely (e.g. in the Community DM Notifications category and in the Slack #dm channel).

              People

              Assignee:
              jhoblitt Joshua Hoblitt
              Reporter:
              jhoblitt Joshua Hoblitt
              Watchers:
              Frossie Economou, Gabriele Comoretto, Joshua Hoblitt, Kian-Tat Lim, Simon Krughoff
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: