Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11810

meas_algorithms fails on NFS-mounted systems

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Team:
      External

      Description

      I get the attached pytest*xml*failed file when building mease_algorithms on an NFS-mounted Linux machine. I cannot reproduce the bug on a non-NFS mounted machine.

        Attachments

          Activity

          Ascending order - Click to sort in descending order
          Hide
          Permalink
          tjenness Tim Jenness added a comment -

          A naive look is suggesting daf_persistence again:

          key = 3
          		 
          psf = <lsst.meas.algorithms.doubleGaussianPsf.DoubleGaussianPsf object at 0x7fca627e56f8>
          		 
           
          		 
              def roundTripPsf(key, psf):
          		 
                  global psfFileNum
          		 
                  pol = policy.Policy()
          		 
                  additionalData = dafBase.PropertySet()
          		 
              
                  if psfFileNum % 2 == 1:
          		 
                      storageType = "Boost"
          		 
                  else:
          		 
                      storageType = "Xml"
          		 
                  loc = dafPersist.LogicalLocation(
          		 
                      "tests/data/psf%d-%d.%s" % (psfFileNum, key, storageType))
          		 
                  psfFileNum += 1
          		 
                  persistence = dafPersist.Persistence.getPersistence(pol)
          		 
              
                  storageList = dafPersist.StorageList()
          		 
                  storage = persistence.getPersistStorage("%sStorage" % (storageType), loc)
          		 
                  storageList.append(storage)
          		 
                  persistence.persist(psf, storageList, additionalData)
          		 
              
                  storageList2 = dafPersist.StorageList()
          		 
          >       storage2 = persistence.getRetrieveStorage("%sStorage" % (storageType), loc)
          		 
          E       RuntimeError: unrecognized XML syntax
          		 
           
          		 
          tests/test_psfIO.py:78: RuntimeError

          Show
          tjenness Tim Jenness added a comment - A naive look is suggesting daf_persistence again: key = 3 psf = <lsst.meas.algorithms.doubleGaussianPsf.DoubleGaussianPsf object at 0x7fca627e56f8>   def roundTripPsf(key, psf): global psfFileNum pol = policy.Policy() additionalData = dafBase.PropertySet() if psfFileNum % 2 == 1: storageType = "Boost" else: storageType = "Xml" loc = dafPersist.LogicalLocation( "tests/data/psf%d-%d.%s" % (psfFileNum, key, storageType)) psfFileNum += 1 persistence = dafPersist.Persistence.getPersistence(pol) storageList = dafPersist.StorageList() storage = persistence.getPersistStorage("%sStorage" % (storageType), loc) storageList.append(storage) persistence.persist(psf, storageList, additionalData) storageList2 = dafPersist.StorageList() > storage2 = persistence.getRetrieveStorage("%sStorage" % (storageType), loc) E RuntimeError: unrecognized XML syntax   tests/test_psfIO.py:78: RuntimeError
          Hide
          Permalink
          danielsf Scott Daniel added a comment -

          For the record, I was not having any trouble with meas_algorithms until between 2pm and 3pm PDT on September 5.

          Show
          danielsf Scott Daniel added a comment - For the record, I was not having any trouble with meas_algorithms until between 2pm and 3pm PDT on September 5.
          Hide
          Permalink
          danielsf Scott Daniel added a comment - - edited

          Nate Pease has diagnosed the problem as being an improper scratch space directory (i.e. not using tempfile.mkdtemp) in test_psfIO.py.

          Show
          danielsf Scott Daniel added a comment - - edited Nate Pease has diagnosed the problem as being an improper scratch space directory (i.e. not using tempfile.mkdtemp ) in test_psfIO.py .
          Hide
          Permalink
          tjenness Tim Jenness added a comment -

          Thanks. Looks good.

          Show
          tjenness Tim Jenness added a comment - Thanks. Looks good.

            People

            Assignee:
            danielsf Scott Daniel
            Reporter:
            danielsf Scott Daniel
            Reviewers:
            Tim Jenness
            Watchers:
            Nate Pease [X] (Inactive), Scott Daniel, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.