Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21999

Jenkins fails to build macOS binaries

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Continuous Integration
    • Labels:
      None
    • Templates:
    • Story Points:
      3
    • Epic Link:
    • Team:
      SQuaRE

      Description

      The Jenkins nightly and weekly release builds are failing to build binary packages for macOS (although Linux is fine).

      For example, look at nightly #792 or weekly #256.

      In both cases, the pipeline superficially appears to have completed successfully. However, in fact the “build eups tarballs” stage failed on osx-10.14.clang-1000.10.44.4.miniconda3-4.5.12-f032070 with the (repeated) message:

      Scheduling project: release » tarball
      Starting building: release » tarball #4830
      release » tarball #4830 completed with status FAILURE (propagate: false to ignore)
      

      then eventually

      giving up on build but suppressing error
      

      This error is due to a failure to find a dylib in the astshim package:

      ____________________ ERROR collecting tests/test_append.py _____________________
      ImportError while importing test module '/Users/square/j/ws/release/tarball/osx/10.9/clang-1000.10.44.4/miniconda3-4.5.12-f032070/build/stack/miniconda3-4.5.12-f032070/EupsBuildDir/DarwinX86/astshim-18.0.0+6/astshim-18.0.0+6/tests/test_append.py'.
      Hint: make sure your test modules/packages have valid Python names.
      Traceback:
      tests/test_append.py:5: in <module>
          from astshim import Frame, SkyFrame, UnitMap, FrameSet, append
      python/astshim/__init__.py:26: in <module>
          from .base import *
      E   ImportError: dlopen(/Users/square/j/ws/release/tarball/osx/10.9/clang-1000.10.44.4/miniconda3-4.5.12-f032070/build/stack/miniconda3-4.5.12-f032070/EupsBuildDir/DarwinX86/astshim-18.0.0+6/astshim-18.0.0+6/python/astshim/base.so, 2): Library not loaded: libastshim.dylib
      E     Referenced from: /Users/square/j/ws/release/tarball/osx/10.9/clang-1000.10.44.4/miniconda3-4.5.12-f032070/build/stack/miniconda3-4.5.12-f032070/EupsBuildDir/DarwinX86/astshim-18.0.0+6/astshim-18.0.0+6/python/astshim/base.so
      E     Reason: image not found
      

      However:

      • I am able to build astshim, using the same eups distrib incantation as Jenkins, on my macOS laptop with no problems;
      • Jenkins has itself built this version of astshim in an equivalent Conda environment as part of the stack-os-matrix — this failure appears to be peculiar to the release pipelines.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                krughoff Simon Krughoff
                Reporter:
                swinbank John Swinbank
                Reviewers:
                Tim Jenness
                Watchers:
                Eli Rykoff, Frossie Economou, Gabriele Comoretto, John Swinbank, Joshua Hoblitt, Kian-Tat Lim, Simon Krughoff, Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel