[DM-15558] re-enable osx tarball builds - Jira

XML

Word

Printable

Details

Type: Story
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: Continuous Integration, stack release
Labels:
None

Story Points:
1
Epic Link:
sqr-f18-ops-1
Team:
SQuaRE

Description

EUPS binary/tarball builds on osx were disabled many weeks ago due to strange problems with eups https downloads from eups.lsst.codes hanging. Since that time, the sqre osx environment has been "white-listed" with the NOAO traffic mangler – it needs to be determined if this has resolved the problem and if not, the root cause needs to be identified.

Attachments

Issue Links

is triggering

DM-15674 provision additional jenkins osx 10.12 build nodes

Done

mitigates

DM-14013 allow manual config of newinstall.sh platform/compiler strings

Done

Activity

Ascending order - Click to sort in descending order

Hide

Permalink

Joshua Hoblitt added a comment - 28/Aug/18 11:16 AM - edited

The d.2018.08.28 nightly failed trying to build astshim on osx:

c++ -o python/astshim/detail/testUtils.so -bundle -F/ -undefined suppress -flat_namespace -headerpad_max_install_names python/astshim/detail/testUtils.os -Llib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/stack/miniconda3-4.5.4-fcd27eb/DarwinX86/starlink_ast/lsst-dev-gd6cc4e835a/lib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/stack/miniconda3-4.5.4-fcd27eb/DarwinX86/fftw/3.3.4.lsst2/lib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/stack/miniconda3-4.5.4-fcd27eb/DarwinX86/boost/1.68/lib/ -L/Users/square/j/ws/release/tarball/osx/10.9/clang-800.0.42.1/miniconda3-4.5.4-fcd27eb/build/python/miniconda3-4.5.4/envs/lsst-scipipe-fcd27eb/lib/python3.6/config-3.6m-darwin/ -lastshim -last -last_pal -last_grf_2.0 -last_grf_3.2 -last_grf_5.6 -last_grf3d -last_pass2 -last_err -lm -lfftw3f -lfftw3 -lpthread -ldl -lpython3.6m

error: Unknown attribute kind (52) (Producer: 'LLVM4.0.1' Reader: 'LLVM APPLE_1_800.0.42.1_0')

clang: error: linker command failed with exit code 1 (use -v to see invocation)

scons: *** [python/astshim/detail/testUtils.so] Error 1

scons: building terminated because of errors.

+ exit -4

Modifications have been merged to allow the osx tarball build to run on osx-10.12 (instead of osx-10.11) and a test build has made it past astshim:

https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3220/pipeline

Show

Joshua Hoblitt added a comment - 28/Aug/18 11:16 AM - edited The d.2018.08.28 nightly failed trying to build astshim on osx: c++ -o python/astshim/detail/testUtils.so -bundle -F/ -undefined suppress -flat_namespace -headerpad_max_install_names python/astshim/detail/testUtils.os -Llib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/stack/miniconda3- 4.5 . 4 -fcd27eb/DarwinX86/starlink_ast/lsst-dev-gd6cc4e835a/lib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/stack/miniconda3- 4.5 . 4 -fcd27eb/DarwinX86/fftw/ 3.3 . 4 .lsst2/lib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/stack/miniconda3- 4.5 . 4 -fcd27eb/DarwinX86/boost/ 1.68 /lib/ -L/Users/square/j/ws/release/tarball/osx/ 10.9 /clang- 800.0 . 42.1 /miniconda3- 4.5 . 4 -fcd27eb/build/python/miniconda3- 4.5 . 4 /envs/lsst-scipipe-fcd27eb/lib/python3. 6 /config- 3 .6m-darwin/ -lastshim -last -last_pal -last_grf_2. 0 -last_grf_3. 2 -last_grf_5. 6 -last_grf3d -last_pass2 -last_err -lm -lfftw3f -lfftw3 -lpthread -ldl -lpython3.6m error: Unknown attribute kind ( 52 ) (Producer: 'LLVM4.0.1' Reader: 'LLVM APPLE_1_800.0.42.1_0' ) clang: error: linker command failed with exit code 1 (use -v to see invocation) scons: *** [python/astshim/detail/testUtils.so] Error 1 scons: building terminated because of errors. + exit - 4 https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3216/pipeline/ https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3217/pipeline/ https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3217/pipeline/ Modifications have been merged to allow the osx tarball build to run on osx-10.12 (instead of osx-10.11 ) and a test build has made it past astshim : https://ci.lsst.codes/blue/organizations/jenkins/release%2Ftarball/detail/tarball/3220/pipeline

Hide

Permalink

Joshua Hoblitt added a comment - 28/Aug/18 3:02 PM

The astshim failure was non-reproducible on osx 10.12 – it isn't clear if this is due to the compiler or something else. Anyways, we were overdue to drop 10.11 anyways – so jenkins and newinstall.sh have been updated to to switch to building only on osx 10.12 / changing the eups distrib tarball compiler string for osx to clang-802.0.42.

Show

Joshua Hoblitt added a comment - 28/Aug/18 3:02 PM The astshim failure was non-reproducible on osx 10.12 – it isn't clear if this is due to the compiler or something else. Anyways, we were overdue to drop 10.11 anyways – so jenkins and newinstall.sh have been updated to to switch to building only on osx 10.12 / changing the eups distrib tarball compiler string for osx to clang-802.0.42 .

Hide

Permalink

Kian-Tat Lim added a comment - 29/Aug/18 10:53 AM

Please announce any new eups.lsst.codes binary distribution URLs widely (e.g. in the Community DM Notifications category and in the Slack #dm channel).

Show

Kian-Tat Lim added a comment - 29/Aug/18 10:53 AM Please announce any new eups.lsst.codes binary distribution URLs widely (e.g. in the Community DM Notifications category and in the Slack #dm channel).

People

Assignee:

Joshua Hoblitt

Reporter:

Joshua Hoblitt

Watchers:

Frossie Economou, Gabriele Comoretto, Joshua Hoblitt, Kian-Tat Lim, Simon Krughoff

Votes:

0 Vote for this issue

Watchers:

5 Start watching this issue

Dates

Created:

27/Aug/18 1:22 PM

Updated:

28/Sep/18 2:15 PM

Resolved:

07/Sep/18 2:10 PM

Summary Panel