Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9848

obs_subaru test failures possibly related to daf_persistence

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: daf_persistence, obs_base
    • Labels:
      None
    • Templates:
    • Story Points:
      1
    • Sprint:
      DB_S17_2
    • Team:
      Data Access and Database

      Description

      Both Michael Wood-Vasey and myself have seen obs_subaru test failures today. In my case, the test failure was non-reproducible. I am concerned that this might be a concurrent butler access issue.

      https://ci.lsst.codes/job/release/job/run-rebuild/472/consoleFull#console-section-13

      [2017-03-16T18:08:21.499615Z] Traceback (most recent call last):
      [2017-03-16T18:08:21.499681Z] Traceback (most recent call last):
      [2017-03-16T18:08:21.499703Z]   File "bin.src/genDefectFits.py", line 86, in <module>
      [2017-03-16T18:08:21.499727Z]   File "bin.src/genDefectFits.py", line 86, in <module>
      [2017-03-16T18:08:21.499748Z]     genDefectFits(args.cameraName, args.defectsFile, args.targetDir)
      [2017-03-16T18:08:21.499771Z]     genDefectFits(args.cameraName, args.defectsFile, args.targetDir)
      [2017-03-16T18:08:21.499789Z]   File "bin.src/genDefectFits.py", line 20, in genDefectFits
      [2017-03-16T18:08:21.499808Z]   File "bin.src/genDefectFits.py", line 20, in genDefectFits
      [2017-03-16T18:08:21.499825Z]     mapper = mapperMap[cameraName.lower()](root=".")
      [2017-03-16T18:08:21.499844Z]     mapper = mapperMap[cameraName.lower()](root=".")
      [2017-03-16T18:08:21.499875Z]   File "/home/lsstsw/jenkins/release/lsstsw/build/obs_subaru/python/lsst/obs/hsc/hscMapper.py", line 31, in __init__
      [2017-03-16T18:08:21.499912Z]   File "/home/lsstsw/jenkins/release/lsstsw/build/obs_subaru/python/lsst/obs/hsc/hscMapper.py", line 31, in __init__
      [2017-03-16T18:08:21.499936Z]     super(HscMapper, self).__init__(policy, policyFile.getRepositoryPath(), **kwargs)
      [2017-03-16T18:08:21.499974Z]       File "/home/lsstsw/jenkins/release/lsstsw/stack/Linux64/obs_base/13.0-5-g36cc3d4+1/python/lsst/obs/base/cameraMapper.py", line 223, in __init__
      [2017-03-16T18:08:21.500009Z] super(HscMapper, self).__init__(policy, policyFile.getRepositoryPath(), **kwargs)
      [2017-03-16T18:08:21.500050Z]   File "/home/lsstsw/jenkins/release/lsstsw/stack/Linux64/obs_base/13.0-5-g36cc3d4+1/python/lsst/obs/base/cameraMapper.py", line 223, in __init__
      [2017-03-16T18:08:21.500392Z]     calibStorage = dafPersist.Storage.makeFromURI(uri=calibRoot)
      [2017-03-16T18:08:21.500448Z]   File "/home/lsstsw/jenkins/release/lsstsw/stack/Linux64/daf_persistence/13.0-4-g886c4ba/python/lsst/daf/persistence/storage/storageContinued.py", line 144, in makeFromURI
      [2017-03-16T18:08:21.500470Z]     calibStorage = dafPersist.Storage.makeFromURI(uri=calibRoot)
      [2017-03-16T18:08:21.500516Z]   File "/home/lsstsw/jenkins/release/lsstsw/stack/Linux64/daf_persistence/13.0-4-g886c4ba/python/lsst/daf/persistence/storage/storageContinued.py", line 144, in makeFromURI
      [2017-03-16T18:08:21.500969Z] CameraMapper INFO: Unable to locate registry registry in root: registry.sqlite3
      [2017-03-16T18:08:21.501428Z] CameraMapper INFO: Unable to locate registry registry in current dir: ./registry.sqlite3
      [2017-03-16T18:08:21.501771Z] CameraMapper INFO: Loading Posix registry from .
      [2017-03-16T18:08:21.502249Z] CameraMapper INFO: Unable to locate calibRegistry registry in root: calibRegistry.sqlite3
      [2017-03-16T18:08:21.502676Z] CameraMapper INFO: Unable to locate calibRegistry registry in current dir: ./calibRegistry.sqlite3
      [2017-03-16T18:08:21.503010Z] CameraMapper INFO: Loading Posix registry from ./CALIB
      [2017-03-16T18:08:21.506297Z] CameraMapper INFO: Unable to locate registry registry in root: registry.sqlite3
      [2017-03-16T18:08:21.507001Z] CameraMapper INFO: Unable to locate registry registry in current dir: ./registry.sqlite3
      [2017-03-16T18:08:21.507448Z] CameraMapper INFO: Loading Posix registry from .
      [2017-03-16T18:08:21.507975Z] CameraMapper INFO: Unable to locate calibRegistry registry in root: calibRegistry.sqlite3
      [2017-03-16T18:08:21.508473Z] CameraMapper INFO: Unable to locate calibRegistry registry in current dir: ./calibRegistry.sqlite3
      [2017-03-16T18:08:21.508875Z] CameraMapper INFO: Loading Posix registry from ./CALIB
      [2017-03-16T18:08:21.513985Z]     ret = theClass(uri=uri)
      [2017-03-16T18:08:21.514008Z]     ret = theClass(uri=uri)
      [2017-03-16T18:08:21.514060Z]   File "/home/lsstsw/jenkins/release/lsstsw/stack/Linux64/daf_persistence/13.0-4-g886c4ba/python/lsst/daf/persistence/posixStorage.py", line 55, in __init__
      [2017-03-16T18:08:21.514114Z]   File "/home/lsstsw/jenkins/release/lsstsw/stack/Linux64/daf_persistence/13.0-4-g886c4ba/python/lsst/daf/persistence/posixStorage.py", line 55, in __init__
      [2017-03-16T18:08:21.520395Z]     os.makedirs(self.root)
      [2017-03-16T18:08:21.520437Z]   File "/home/lsstsw/jenkins/release/lsstsw/miniconda/lib/python2.7/os.py", line 157, in makedirs
      [2017-03-16T18:08:21.520468Z]     os.makedirs(self.root)
      [2017-03-16T18:08:21.520512Z]   File "/home/lsstsw/jenkins/release/lsstsw/miniconda/lib/python2.7/os.py", line 157, in makedirs
      [2017-03-16T18:08:21.536157Z]     mkdir(name, mode)
      [2017-03-16T18:08:21.536186Z]     mkdir(name, mode)
      [2017-03-16T18:08:21.536237Z] OSError: [Errno 17] File exists: './CALIB'
      [2017-03-16T18:08:21.536264Z] OSError: [Errno 17] File exists: './CALIB'
      [2017-03-16T18:08:21.619152Z] scons: *** [hsc/defects/2014-06-01/defects.dat-fits] Error 1
      [2017-03-16T18:08:21.623222Z] scons: *** [hsc/defects/2013-01-31/defects.dat-fits] Error 1
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                npease Nate Pease
                Reporter:
                jhoblitt Joshua Hoblitt
                Reviewers:
                Tim Jenness
                Watchers:
                John Swinbank, Joshua Hoblitt, Joshua Meyers, Kian-Tat Lim, Michael Wood-Vasey, Nate Pease, Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel