Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-7386

Jenkins/lsstsw no longer seems to build optional dependencies in all cases

    XMLWordPrintable

    Details

    • Story Points:
      0.5
    • Team:
      Architecture

      Description

      If I ask Jenkins (or lsstsw) to build skymap the optional dependency of healpy is not included in the build. If I try to build afw it does include the optional dependencies of pyfits, matplotlib and afwdata. pipe_base does bring in its optional dependencies as well.

      I haven't worked out what is "special" about skymap.

      For an example Jenkins build: https://ci.lsst.codes/job/stack-os-matrix/label=centos-7,python=py3/14837//console

      Table file:

      setupRequired(numpy)
      setupRequired(afw)
      setupOptional(healpy)
      

        Attachments

          Activity

          Hide
          frossie Frossie Economou added a comment -

          Naive question, but what is healpy, and should I expect to see it in lsst_distrib?

          Show
          frossie Frossie Economou added a comment - Naive question, but what is healpy, and should I expect to see it in lsst_distrib?
          Hide
          tjenness Tim Jenness added a comment -

          healpy can be found at https://github.com/lsst/healpy.git

          It's a required dependency of sims_utils, sims_maf and sims_skybrightness. Optional dependency for skymap.

          Show
          tjenness Tim Jenness added a comment - healpy can be found at https://github.com/lsst/healpy.git It's a required dependency of sims_utils, sims_maf and sims_skybrightness. Optional dependency for skymap.
          Hide
          wmwood-vasey Michael Wood-Vasey added a comment -

          1. healpy is a Python library for HEALPIX, which is a civilized way of dividing up a sphere into regions in a hierarchy of levels. It's really useful for any large-scale analysis, and so is perfect for sims_*.

          http://healpix.jpl.nasa.gov

          It stands for (I had to look this up): "Hierarchical Equal Area isoLatitude Pixelization"

          2. Because it's an optional dependency of skymap you should expect to see it in lsst_distrib "sometimes". This ticket is about the fact that "sometimes" is confusing and appears to be inconsistent. In general it seems that lsstsw builds all optional dependencies, but it doesn't build this one when building skymap.

          Show
          wmwood-vasey Michael Wood-Vasey added a comment - 1. healpy is a Python library for HEALPIX, which is a civilized way of dividing up a sphere into regions in a hierarchy of levels. It's really useful for any large-scale analysis, and so is perfect for sims_* . http://healpix.jpl.nasa.gov It stands for (I had to look this up): "Hierarchical Equal Area isoLatitude Pixelization" 2. Because it's an optional dependency of skymap you should expect to see it in lsst_distrib "sometimes". This ticket is about the fact that "sometimes" is confusing and appears to be inconsistent. In general it seems that lsstsw builds all optional dependencies, but it doesn't build this one when building skymap .
          Hide
          tjenness Tim Jenness added a comment -

          Bang head on table: https://github.com/lsst/lsstsw/blob/master/etc/exclusions.txt#L7

          An entity called "LSST Software Manager" explicitly excluded healpy from builds in 2014 (which was the first commit of lsstsw. Was that Mario Juric? Was this because at the time healpy didn't build at all?

          I'll file a pull request. Sigh.

          Show
          tjenness Tim Jenness added a comment - Bang head on table: https://github.com/lsst/lsstsw/blob/master/etc/exclusions.txt#L7 An entity called "LSST Software Manager" explicitly excluded healpy from builds in 2014 (which was the first commit of lsstsw . Was that Mario Juric ? Was this because at the time healpy didn't build at all? I'll file a pull request. Sigh.
          Hide
          jhoblitt Joshua Hoblitt added a comment -

          <facepalm> +1 on PR.

          Show
          jhoblitt Joshua Hoblitt added a comment - <facepalm> +1 on PR.
          Hide
          tjenness Tim Jenness added a comment -

          Thanks for the review. I'll merge once travis completes on the PR.

          Show
          tjenness Tim Jenness added a comment - Thanks for the review. I'll merge once travis completes on the PR.
          Hide
          tjenness Tim Jenness added a comment -

          Merged.

          Show
          tjenness Tim Jenness added a comment - Merged.

            People

            Assignee:
            tjenness Tim Jenness
            Reporter:
            tjenness Tim Jenness
            Watchers:
            Frossie Economou, J Matt Peterson [X] (Inactive), Joshua Hoblitt, Michael Wood-Vasey, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.