Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6213

Conda binary distribution improvements

    Details

    • Epic Name:
      sqre-f16-conda
    • Story Points:
      16
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Fall 2016

      Attachments

        Issue Links

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        DM-8135

        Fixup and complete v12.1 Conda binary packages

        5 J Matt Peterson [X] (Inactive) Done
         
        DM-8134

        Investigate using Conda Forge's docker image

        5 J Matt Peterson [X] (Inactive) Done
         
        DM-8133

        Investigate CentOS5 with alternative GCC versions

        10 J Matt Peterson [X] (Inactive) Done
         
        DM-8132

        Investigate CentOS5 with GCC 5.2.0

        7 J Matt Peterson [X] (Inactive) Done
         
        DM-8131

        Investigate different combinations of cmake and other lsstsw dependencies

        4 J Matt Peterson [X] (Inactive) Done
         
        DM-8130

        Reproduce conda-lsst problems using lsstsw

        3 J Matt Peterson [X] (Inactive) Done
         
        DM-8129

        Demo breaks with Conda v12.1 binaries because of missing libexpat.so.0 file.

        3 J Matt Peterson [X] (Inactive) Done
         
        DM-8083

        The eups mariadb and mariadbclient packages don't build on Mac OS X El Capitan with XCode 8.

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-8072

        Conda-lsst broken when running make-recipes

        0.5 J Matt Peterson [X] (Inactive) Done
         
        DM-8029

        Conda-lsst Linux lsst-afw build failure on CentOS5.

        2 Jim Bosch Done
         
        DM-7977

        Create a docker image for Conda binary creation

        5 J Matt Peterson [X] (Inactive) Done
         
        DM-7747

        conda-lsst mpi4py build failure.

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-7701

        conda-lsst ndarray test failure

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-7666

        conda-lsst broken with conda >= 4.2.6

        0.5 J Matt Peterson [X] (Inactive) Done
         
        DM-7220

        New conda-build breaks conda-lsst

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-7219

        Add SWIG conda recipe to conda-lsst

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-7499

        Merge in external updates to lsst-sqre/conda-lsst

        0.5 J Matt Peterson [X] (Inactive) Done
         
        DM-7340

        Add lsst-mariadbclient recipe to conda-lsst

        3 J Matt Peterson [X] (Inactive) Done
         
        DM-6476

        Report and work around conda repository change

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-6471

        Conda eups packages don't work if eups is already configured

        1 J Matt Peterson [X] (Inactive) Done
         
        DM-6441

        Ansible automation to run conda-lsst.

        6 J Matt Peterson [X] (Inactive) Done
         
        DM-7449

        Add eups python_future dependency to galsim

        0.5 J Matt Peterson [X] (Inactive) Done
         
        DM-7980

        conda-lsst Linux lsst-wcslib build failure.

        1 J Matt Peterson [X] (Inactive) Won't Fix
         
        DM-7774

        conda-lsst Linux lsst-fftw build failure.

        7 J Matt Peterson [X] (Inactive) Won't Fix
         
        DM-7236

        Upgrade to boost 1.61.x

        0.5 J Matt Peterson [X] (Inactive) Won't Fix
         
        DM-7051

        conda installation from the stack channel brings in astropy 1.2

        2 J Matt Peterson [X] (Inactive) Won't Fix

          Activity

          Hide
          jmatt J Matt Peterson [X] (Inactive) added a comment - - edited

          The Conda v12.1 (semantic version 0.12.1) binaries have been successfully created. The repository for this release is: http://conda.lsst.codes/stack/0.12.1

          This will be the current stable version until v13 is release. So it will also be availalbe at: http://conda.lsst.codes/stack while it is the current stable Conda release.

          There are some notable differences between the versions.

          The Mac OS X Conda binaries are pinned to astropy 1.1.2 and numpy 1.10.4

          The Linux Conda binaries were built with astropy 1.1.2 but allow for versions < 1.3. And numpy was built with numpy 1.10.4 and allow for versions < 1.12.

          The nomkl conda feature is still part of 12.1. There were issues building before I merged any of the work that Mario Juric did this summer.

          The Linux Conda binaries use MariaDB and MariaDBClient 10.1.18. This is because there were issues building and linking with 10.1.11.

          DM-8029 and RFC-250 were required to build afw, ip_diffim and meas_algorithms for the Linux conda binaries.

          I'd like to especially thank Tim Jenness, Frossie Economou, Joshua Hoblitt, Robert Lupton, Jim Bosch and sqre for their assistance.

          Show
          jmatt J Matt Peterson [X] (Inactive) added a comment - - edited The Conda v12.1 (semantic version 0.12.1) binaries have been successfully created. The repository for this release is: http://conda.lsst.codes/stack/0.12.1 This will be the current stable version until v13 is release. So it will also be availalbe at: http://conda.lsst.codes/stack while it is the current stable Conda release. There are some notable differences between the versions. The Mac OS X Conda binaries are pinned to astropy 1.1.2 and numpy 1.10.4 The Linux Conda binaries were built with astropy 1.1.2 but allow for versions < 1.3. And numpy was built with numpy 1.10.4 and allow for versions < 1.12. The nomkl conda feature is still part of 12.1. There were issues building before I merged any of the work that Mario Juric did this summer. The Linux Conda binaries use MariaDB and MariaDBClient 10.1.18. This is because there were issues building and linking with 10.1.11. DM-8029 and RFC-250 were required to build afw, ip_diffim and meas_algorithms for the Linux conda binaries. I'd like to especially thank Tim Jenness , Frossie Economou , Joshua Hoblitt , Robert Lupton , Jim Bosch and sqre for their assistance.
          Hide
          jbosch Jim Bosch added a comment -

          I'm doing a final Jenkins run on DM-8029 before merging that to master (hopefully later today); before that happens we shouldn't try to build source packages against the binary release.

          Show
          jbosch Jim Bosch added a comment - I'm doing a final Jenkins run on DM-8029 before merging that to master (hopefully later today); before that happens we shouldn't try to build source packages against the binary release.
          Hide
          jbosch Jim Bosch added a comment -

          DM-8029 has been merged to master.

          Show
          jbosch Jim Bosch added a comment - DM-8029 has been merged to master.
          Hide
          frossie Frossie Economou added a comment -

          The work was done, but it blew up to 4.5 x estimated and displaced several other pieces of work. We had a lessons learned exercise and will be addressing the underlying issues in S17.

          Show
          frossie Frossie Economou added a comment - The work was done, but it blew up to 4.5 x estimated and displaced several other pieces of work. We had a lessons learned exercise and will be addressing the underlying issues in S17.

            People

            • Assignee:
              jmatt J Matt Peterson [X] (Inactive)
              Reporter:
              frossie Frossie Economou
              Watchers:
              Frossie Economou, Jim Bosch, J Matt Peterson [X] (Inactive), Mario Juric
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel