Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-5123

develop strategy for handling environments with Intel's MKL library

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: afw
    • Labels:
      None
    • Templates:
    • Team:
      Architecture

      Description

      Per discussion with Tim Jenness and a bit of symbol table inspection, the root cause of the issue observed in DM-5105 is likely due to the Intel MKL library duplicating symbols which are present in fftw, blas, etc.. Eg.,

      https://software.intel.com/en-us/node/522277

      After discussion with CA sales, it has been clarified that the new mkl conda packages are under different terms than the previous MKL Optimized "add-ons".

      http://docs.continuum.io/anaconda/eula

      The new license is permissive and allows redistribution. It is reasonable to assume that MKL will be present on more LSST enduser's systems in the future and we need a strategy for managing linking to prevent symbol conflicts. A few possibilities are:

      • remove fftw, openblas, etc. from the stack and link solely with MKL (unknown if it is a 100% replacement and this would tie us to the conda package with the permissive eula)
      • officially declare MKL as unsupported
      • create library stubs (ie., symlinks) so that -lfftw/etc. will continue to work and re-plumb how EUPS handles optional dependencies so we can switch between openblas/fftw and MKL
      • modify our scons probing logic to be able to select between the various library options and re-plumb EUPS optional dependency handling

        Attachments

          Container Issues

            Issue Links

              Activity

                People

                • Assignee:
                  tjenness Tim Jenness
                  Reporter:
                  jhoblitt Joshua Hoblitt
                  Reviewers:
                  Mario Juric
                  Watchers:
                  Chris Walter, Dominique Boutigny, Frossie Economou, Jim Bosch, John Parejko, John Swinbank, Joshua Hoblitt, Kian-Tat Lim, Mario Juric, Paul Price, Robert Lupton, Tim Jenness
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  12 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel