Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18022

meas_modelfit test_truncatedGaussian.py failure using bleed environment

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Using a bleed version of the conda environment, meas_modelfit test TruncatedGaussianTestCase is failing

       

      Error Message

      AssertionError: True is not false : 1/4 elements differ with rtol=2.220446049250313e-16, atol=2.220446049250313e-16 2.500000000000001 != 2.5 (diff=8.881784197001252e-16/2.500000000000001=3.5527136788004996e-16)

      Stacktrace

      self = <test_truncatedGaussian.TruncatedGaussianTestCase testMethod=test2d> def test2d(self): if scipy is None: return for i in range(5): x = numpy.linspace(-1, 1, 5) model = numpy.zeros((x.size, 2), dtype=float) model[:, 0] = x model[:, 1] = x**2 + x data = numpy.random.randn(x.size) + model[:, 0]*0.9 + model[:, 1]*1.1 q0 = 0.5*float(numpy.dot(data, data)) gradient = -numpy.dot(model.transpose(), data) hessian = numpy.dot(model.transpose(), model) sigma = numpy.linalg.inv(hessian) > self.assertFloatsAlmostEqual(numpy.linalg.inv(sigma), hessian) tests/test_truncatedGaussian.py:161: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../../stack/Linux64/utils/16.0-18-g0a50484+1/python/lsst/utils/tests.py:735: in assertFloatsAlmostEqual testCase.assertFalse(failed, msg="\n".join(errMsg)) E AssertionError: True is not false : 1/4 elements differ with rtol=2.220446049250313e-16, atol=2.220446049250313e-16 E 2.500000000000001 != 2.5 (diff=8.881784197001252e-16/2.500000000000001=3.5527136788004996e-16)
      {{  }}
      {{  }}

        Attachments

          Activity

          No builds found.
          gcomoretto Gabriele Comoretto [X] (Inactive) created issue -
          Hide
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment - - edited

          The problem is just when building in Linux.

          Numpy new version is 1.5.4. The old version is 1.4.5.

          Scipy new version is 1.2.0. The old version is 1.1.0.

           

          In attachment the sdiff between environemnts.

          Show
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment - - edited The problem is just when building in Linux. Numpy new version is 1.5.4. The old version is 1.4.5. Scipy new version is 1.2.0. The old version is 1.1.0.   In attachment the sdiff between environemnts.
          gcomoretto Gabriele Comoretto [X] (Inactive) made changes -
          Field Original Value New Value
          Attachment condaPkgDiffs.txt [ 36998 ]
          swinbank John Swinbank made changes -
          Team Data Release Production [ 10301 ]
          Watchers Gabriele Comoretto, Tim Jenness [ Gabriele Comoretto, Tim Jenness ] Gabriele Comoretto, Jim Bosch, Tim Jenness [ Gabriele Comoretto, Jim Bosch, Tim Jenness ]
          Assignee Jim Bosch [ jbosch ]
          jbosch Jim Bosch made changes -
          Assignee Jim Bosch [ jbosch ]
          jbosch Jim Bosch made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          jbosch Jim Bosch made changes -
          Description Using a bleed version of the conda environment, meas_modelfit test TruncatedGaussianTestCase is failing

           
          h3. Error Message
          AssertionError: True is not false : 1/4 elements differ with rtol=2.220446049250313e-16, atol=2.220446049250313e-16 2.500000000000001 != 2.5 (diff=8.881784197001252e-16/2.500000000000001=3.5527136788004996e-16)
          h3. Stacktrace
          self = <test_truncatedGaussian.TruncatedGaussianTestCase testMethod=test2d> def test2d(self): if scipy is None: return for i in range(5): x = numpy.linspace(-1, 1, 5) model = numpy.zeros((x.size, 2), dtype=float) model[:, 0] = x model[:, 1] = x**2 + x data = numpy.random.randn(x.size) + model[:, 0]*0.9 + model[:, 1]*1.1 q0 = 0.5*float(numpy.dot(data, data)) gradient = -numpy.dot(model.transpose(), data) hessian = numpy.dot(model.transpose(), model) sigma = numpy.linalg.inv(hessian) > self.assertFloatsAlmostEqual(numpy.linalg.inv(sigma), hessian) tests/test_truncatedGaussian.py:161: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../../stack/Linux64/utils/16.0-18-g0a50484+1/python/lsst/utils/tests.py:735: in assertFloatsAlmostEqual testCase.assertFalse(failed, msg="\n".join(errMsg)) E AssertionError: True is not false : 1/4 elements differ with rtol=2.220446049250313e-16, atol=2.220446049250313e-16 E 2.500000000000001 != 2.5 (diff=8.881784197001252e-16/2.500000000000001=3.5527136788004996e-16)
           
           
          Using a bleed version of the conda environment, meas_modelfit test TruncatedGaussianTestCase is failing

           
          h3. Error Message

          AssertionError: True is not false : 1/4 elements differ with rtol=2.220446049250313e-16, atol=2.220446049250313e-16 2.500000000000001 != 2.5 (diff=8.881784197001252e-16/2.500000000000001=3.5527136788004996e-16)
          h3. Stacktrace

          {{self = <test_truncatedGaussian.TruncatedGaussianTestCase testMethod=test2d> def test2d(self): if scipy is None: return for i in range(5): x = numpy.linspace(-1, 1, 5) model = numpy.zeros((x.size, 2), dtype=float) model[:, 0] = x model[:, 1] = x**2 + x data = numpy.random.randn(x.size) + model[:, 0]*0.9 + model[:, 1]*1.1 q0 = 0.5*float(numpy.dot(data, data)) gradient = -numpy.dot(model.transpose(), data) hessian = numpy.dot(model.transpose(), model) sigma = numpy.linalg.inv(hessian) > self.assertFloatsAlmostEqual(numpy.linalg.inv(sigma), hessian) tests/test_truncatedGaussian.py:161: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../../stack/Linux64/utils/16.0-18-g0a50484+1/python/lsst/utils/tests.py:735: in assertFloatsAlmostEqual testCase.assertFalse(failed, msg="\n".join(errMsg)) E AssertionError: True is not false : 1/4 elements differ with rtol=2.220446049250313e-16, atol=2.220446049250313e-16 E 2.500000000000001 != 2.5 (diff=8.881784197001252e-16/2.500000000000001=3.5527136788004996e-16)}}
          {{  }}
          {{  }}
          Hide
          jbosch Jim Bosch added a comment -

          Gabriele Comoretto [X], are you in a position to see if this solves your problem?  I'm pretty confident it fixes the particular failure you saw, but it's possible that will just reveal more failures.

          Show
          jbosch Jim Bosch added a comment - Gabriele Comoretto [X] , are you in a position to see if this solves your problem?  I'm pretty confident it fixes the particular failure you saw, but it's possible that will just reveal more failures.
          jbosch Jim Bosch made changes -
          Reviewers Gabriele Comoretto [ gcomoretto ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          Hide
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment -

          I am setting up an environment and I will try to build it manually

          Show
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment - I am setting up an environment and I will try to build it manually
          Hide
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment -

          I have executed a couple of runs, one manually, and one on a test Jenkins, using the fix, and I did not get the error.

           

          Show
          gcomoretto Gabriele Comoretto [X] (Inactive) added a comment - I have executed a couple of runs, one manually, and one on a test Jenkins, using the fix, and I did not get the error.  
          gcomoretto Gabriele Comoretto [X] (Inactive) made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          Hide
          jbosch Jim Bosch added a comment -

          Merged to master.

          Show
          jbosch Jim Bosch added a comment - Merged to master.
          jbosch Jim Bosch made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]
          yusra Yusra AlSayyad made changes -
          Epic Link DM-16678 [ 235238 ]
          yusra Yusra AlSayyad made changes -
          Story Points 1

            People

            Assignee:
            jbosch Jim Bosch
            Reporter:
            gcomoretto Gabriele Comoretto [X] (Inactive)
            Reviewers:
            Gabriele Comoretto [X] (Inactive)
            Watchers:
            Gabriele Comoretto [X] (Inactive), Jim Bosch, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.