Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9845

ci_hsc is broken

    Details

    • Team:
      Data Release Production

      Description

      ci_hsc is failing for me on master on both my laptop (macOS python2) and on jenkins (python2).

      Here's the tail of the jenkins _build.log:

      [2017-03-16T19:14:28.427219Z] Touch(".scons/ingestValidation-903342-10")
      [2017-03-16T19:14:28.532113Z] root INFO: raw readable (<class 'lsst.afw.image.exposure.exposure.ExposureU'>): PASS
      [2017-03-16T19:14:28.616352Z] Touch(".scons/ingestValidation-903344-0")
      [2017-03-16T19:14:28.693406Z] CameraMapper INFO: Unable to locate calibRegistry registry in root: calibRegistry.sqlite3
      [2017-03-16T19:14:28.694046Z] CameraMapper INFO: Unable to locate calibRegistry registry in current dir: ./calibRegistry.sqlite3
      [2017-03-16T19:14:28.694585Z] CameraMapper INFO: Loading Posix registry from /home/jenkins-slave/workspace/stack-os-matrix/label/centos-6/python/py2/lsstsw/build/ci_hsc/DATA/CALIB
      [2017-03-16T19:14:28.835396Z] root INFO: raw exists: PASS
      [2017-03-16T19:14:29.013235Z] root INFO: raw readable (<class 'lsst.afw.image.exposure.exposure.ExposureU'>): PASS
      [2017-03-16T19:14:29.096432Z] Touch(".scons/ingestValidation-903338-18")
      [2017-03-16T19:14:29.554081Z] root INFO: raw exists: PASS
      [2017-03-16T19:14:29.727097Z] root INFO: raw readable (<class 'lsst.afw.image.exposure.exposure.ExposureU'>): PASS
      [2017-03-16T19:14:29.808739Z] Touch(".scons/ingestValidation-903346-12")
      [2017-03-16T19:14:29.811563Z] scons: building terminated because of errors.
      

        Attachments

          Issue Links

            Activity

            Hide
            npease Nate Pease added a comment -

            I'm pretty sure this had the same root cause as DM-9848, I just checked in a fix for that. Let me know if you continue seeing this issue.

            Show
            npease Nate Pease added a comment - I'm pretty sure this had the same root cause as DM-9848 , I just checked in a fix for that. Let me know if you continue seeing this issue.
            Hide
            jmeyers314 Joshua Meyers added a comment -

            Can confirm that ci_hsc works again on jenkins and my laptop.

            Show
            jmeyers314 Joshua Meyers added a comment - Can confirm that ci_hsc works again on jenkins and my laptop.
            Hide
            jmeyers314 Joshua Meyers added a comment -

            Ack! I take it back. obs_subaru works on my laptop (and I think ci_hsc ran fine through jenkins), but ci_hsc is still broken on my laptop. Latest attempt after rebuilding lsst_distrib:

            [py2 josh@Trogdor src/lsstgit/ci_hsc (master|✔)]$ setup -r .
            [py2 josh@Trogdor src/lsstgit/ci_hsc (master|✔)]$ python $(which scons)             
            scons: Reading SConscript files ...
            Setting OS X binary compatibility level: 10.9
            EUPS integration: enabled
            Checking who built the CC compiler...(cached) clang=8.0.0
            CC is clang version 8.0.0
            Checking for C++11 support
            Checking whether the C++ compiler works... (cached) yes
            C++11 supported with '-std=c++11'
            Mkdir(".scons")
            scons: done reading SConscript files.
            scons: Building targets ...
            DYLD_LIBRARY_PATH="/Users/josh/src/lsstsw/stack/DarwinX86/obs_subaru/13.0-7-g4173d19+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/shapelet/13.0-1-g7218a59+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_modelfit/13.0-5-g78a7c1c+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/healpy/1.8.1.lsst2+5/lib:/Users/josh/src/lsstsw/stack/DarwinX86/skymap/13.0-1-g1710212+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_chisquared/13.0-1-g895cba8+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_diffim/13.0-4-gab7f4cf+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_isr/13.0-3-gc4773c5+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_deblender/13.0-4-ge6413fc+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_shapeHSM/13.0-5-gf5fae43+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/galsim/1.4.3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_psfex/13.0-1-gf76c79a+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/psfex/12.0+13/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_astrom/13.0-2-ge3a4b3c+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astrometry_net/0.67.123ff3e.lsst1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_utils/13.0-1-g8055633+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_base/13.0-5-g267501d/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_algorithms/13.0-4-g692f7ed3+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/starlink_ast/lsst-dev-g48351bb307/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astshim/master-g9d0c5d040f+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/gsl/1.16.lsst3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/minuit2/5.34.14/lib:/Users/josh/src/lsstsw/stack/DarwinX86/wcslib/5.13.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/cfitsio/3360.lsst4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_config/13.0-1-g41367f3+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/afw/13.0-12-g0819d4408/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_base/13.0-1-g174df6e+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_policy/13.0-1-g47a359c+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/mariadbclient/10.1.21.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_exceptions/13.0-1-g52a7baa+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/utils/13.0-1-g976b40b+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/base/13.0-3-g126e4bb+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr_util/1.5.4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr/1.5.2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log4cxx/0.10.0.lsst7/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log/13.0-2-g15de9a1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/tmv/0.73+5/lib:/Users/josh/src/lsstsw/stack/DarwinX86/fftw/3.3.4.lsst2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/boost/1.60.lsst1+1/lib" LSST_LIBRARY_PATH="/Users/josh/src/lsstsw/stack/DarwinX86/obs_subaru/13.0-7-g4173d19+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/shapelet/13.0-1-g7218a59+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_modelfit/13.0-5-g78a7c1c+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/skymap/13.0-1-g1710212+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_chisquared/13.0-1-g895cba8+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_diffim/13.0-4-gab7f4cf+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_isr/13.0-3-gc4773c5+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_deblender/13.0-4-ge6413fc+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_shapeHSM/13.0-5-gf5fae43+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_psfex/13.0-1-gf76c79a+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/psfex/12.0+13/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_astrom/13.0-2-ge3a4b3c+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astrometry_net/0.67.123ff3e.lsst1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_utils/13.0-1-g8055633+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_base/13.0-5-g267501d/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_algorithms/13.0-4-g692f7ed3+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/starlink_ast/lsst-dev-g48351bb307/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astshim/master-g9d0c5d040f+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/gsl/1.16.lsst3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/minuit2/5.34.14/lib:/Users/josh/src/lsstsw/stack/DarwinX86/wcslib/5.13.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/cfitsio/3360.lsst4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_config/13.0-1-g41367f3+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/afw/13.0-12-g0819d4408/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_base/13.0-1-g174df6e+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_policy/13.0-1-g47a359c+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/mariadbclient/10.1.21.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_exceptions/13.0-1-g52a7baa+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/utils/13.0-1-g976b40b+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/base/13.0-3-g126e4bb+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr_util/1.5.4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr/1.5.2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log4cxx/0.10.0.lsst7/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log/13.0-2-g15de9a1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/tmv/0.73+5/lib:/Users/josh/src/lsstsw/stack/DarwinX86/fftw/3.3.4.lsst2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/boost/1.60.lsst1+1/lib" python /Users/josh/src/lsstgit/ci_hsc/bin/validate.py DetrendValidation /Users/josh/src/lsstgit/ci_hsc/DATA --id ccd=16 visit=903986
            root INFO: Validating dataset bias for {'ccd': 16, 'visit': 903986}
            CameraMapper INFO: Unable to locate calibRegistry registry in root: calibRegistry.sqlite3
            CameraMapper INFO: Unable to locate calibRegistry registry in current dir: ./calibRegistry.sqlite3
            CameraMapper INFO: Loading Posix registry from /Users/josh/src/lsstgit/ci_hsc/DATA/CALIB
            Traceback (most recent call last):
              File "/Users/josh/src/lsstgit/ci_hsc/bin/validate.py", line 4, in <module>
                main()
              File "/Users/josh/src/lsstgit/ci_hsc/python/lsst/ci/hsc/validate.py", line 53, in main
                validator.run(dataId)
              File "/Users/josh/src/lsstgit/ci_hsc/python/lsst/ci/hsc/validate.py", line 151, in run
                self.validateDataset(dataId, ds)
              File "/Users/josh/src/lsstgit/ci_hsc/python/lsst/ci/hsc/validate.py", line 114, in validateDataset
                self.assertTrue("%s exists" % dataset, self.butler.datasetExists(datasetType=dataset, dataId=dataId))
              File "/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/butler.py", line 826, in datasetExists
                location = repoData.repo.map(datasetType, dataId)
              File "/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/repository.py", line 241, in map
                loc = self._mapper.map(*args, **kwargs)
              File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_subaru/13.0-7-g4173d19+1/python/lsst/obs/hsc/hscMapper.py", line 158, in map
                location = super(HscMapper, self).map(datasetType, copyId, write=write)
              File "/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/mapper.py", line 167, in map
                return func(self.validate(dataId), write)
              File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_base/13.0-6-g634eb8b/python/lsst/obs/base/cameraMapper.py", line 369, in mapClosure
                return mapping.map(mapper, dataId, write)
              File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_base/13.0-6-g634eb8b/python/lsst/obs/base/mapping.py", line 124, in map
                actualId = self.need(iter(self.keyDict.keys()), dataId)
              File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_base/13.0-6-g634eb8b/python/lsst/obs/base/mapping.py", line 262, in need
                self.datasetType, dataId)
            lsst.daf.persistence.butlerExceptions.NoResults: No unique lookup for [u'calibDate'] from DataId(initialdata={'ccd': 16, 'visit': 903986}, tag=set([])): 0 matches datasetType:bias dataId:DataId(initialdata={'ccd': 16, 'visit': 903986}, tag=set([]))
            scons: *** [.scons/calibValidation-903986-16] Error 1
            scons: building terminated because of errors.
            

            Show
            jmeyers314 Joshua Meyers added a comment - Ack! I take it back. obs_subaru works on my laptop (and I think ci_hsc ran fine through jenkins), but ci_hsc is still broken on my laptop. Latest attempt after rebuilding lsst_distrib: [py2 josh@Trogdor src/lsstgit/ci_hsc (master|✔)]$ setup -r . [py2 josh@Trogdor src/lsstgit/ci_hsc (master|✔)]$ python $(which scons) scons: Reading SConscript files ... Setting OS X binary compatibility level: 10.9 EUPS integration: enabled Checking who built the CC compiler...(cached) clang=8.0.0 CC is clang version 8.0.0 Checking for C++11 support Checking whether the C++ compiler works... (cached) yes C++11 supported with '-std=c++11' Mkdir(".scons") scons: done reading SConscript files. scons: Building targets ... DYLD_LIBRARY_PATH="/Users/josh/src/lsstsw/stack/DarwinX86/obs_subaru/13.0-7-g4173d19+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/shapelet/13.0-1-g7218a59+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_modelfit/13.0-5-g78a7c1c+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/healpy/1.8.1.lsst2+5/lib:/Users/josh/src/lsstsw/stack/DarwinX86/skymap/13.0-1-g1710212+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_chisquared/13.0-1-g895cba8+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_diffim/13.0-4-gab7f4cf+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_isr/13.0-3-gc4773c5+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_deblender/13.0-4-ge6413fc+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_shapeHSM/13.0-5-gf5fae43+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/galsim/1.4.3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_psfex/13.0-1-gf76c79a+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/psfex/12.0+13/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_astrom/13.0-2-ge3a4b3c+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astrometry_net/0.67.123ff3e.lsst1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_utils/13.0-1-g8055633+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_base/13.0-5-g267501d/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_algorithms/13.0-4-g692f7ed3+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/starlink_ast/lsst-dev-g48351bb307/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astshim/master-g9d0c5d040f+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/gsl/1.16.lsst3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/minuit2/5.34.14/lib:/Users/josh/src/lsstsw/stack/DarwinX86/wcslib/5.13.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/cfitsio/3360.lsst4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_config/13.0-1-g41367f3+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/afw/13.0-12-g0819d4408/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_base/13.0-1-g174df6e+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_policy/13.0-1-g47a359c+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/mariadbclient/10.1.21.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_exceptions/13.0-1-g52a7baa+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/utils/13.0-1-g976b40b+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/base/13.0-3-g126e4bb+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr_util/1.5.4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr/1.5.2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log4cxx/0.10.0.lsst7/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log/13.0-2-g15de9a1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/tmv/0.73+5/lib:/Users/josh/src/lsstsw/stack/DarwinX86/fftw/3.3.4.lsst2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/boost/1.60.lsst1+1/lib" LSST_LIBRARY_PATH="/Users/josh/src/lsstsw/stack/DarwinX86/obs_subaru/13.0-7-g4173d19+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/shapelet/13.0-1-g7218a59+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_modelfit/13.0-5-g78a7c1c+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/skymap/13.0-1-g1710212+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_chisquared/13.0-1-g895cba8+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_diffim/13.0-4-gab7f4cf+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/ip_isr/13.0-3-gc4773c5+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_deblender/13.0-4-ge6413fc+3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_shapeHSM/13.0-5-gf5fae43+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_extensions_psfex/13.0-1-gf76c79a+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/psfex/12.0+13/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_astrom/13.0-2-ge3a4b3c+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astrometry_net/0.67.123ff3e.lsst1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/coadd_utils/13.0-1-g8055633+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_base/13.0-5-g267501d/lib:/Users/josh/src/lsstsw/stack/DarwinX86/meas_algorithms/13.0-4-g692f7ed3+4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/starlink_ast/lsst-dev-g48351bb307/lib:/Users/josh/src/lsstsw/stack/DarwinX86/astshim/master-g9d0c5d040f+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/gsl/1.16.lsst3/lib:/Users/josh/src/lsstsw/stack/DarwinX86/minuit2/5.34.14/lib:/Users/josh/src/lsstsw/stack/DarwinX86/wcslib/5.13.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/cfitsio/3360.lsst4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_config/13.0-1-g41367f3+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/afw/13.0-12-g0819d4408/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/daf_base/13.0-1-g174df6e+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_policy/13.0-1-g47a359c+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/mariadbclient/10.1.21.lsst1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/pex_exceptions/13.0-1-g52a7baa+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/utils/13.0-1-g976b40b+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/base/13.0-3-g126e4bb+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr_util/1.5.4/lib:/Users/josh/src/lsstsw/stack/DarwinX86/apr/1.5.2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log4cxx/0.10.0.lsst7/lib:/Users/josh/src/lsstsw/stack/DarwinX86/log/13.0-2-g15de9a1+1/lib:/Users/josh/src/lsstsw/stack/DarwinX86/tmv/0.73+5/lib:/Users/josh/src/lsstsw/stack/DarwinX86/fftw/3.3.4.lsst2/lib:/Users/josh/src/lsstsw/stack/DarwinX86/boost/1.60.lsst1+1/lib" python /Users/josh/src/lsstgit/ci_hsc/bin/validate.py DetrendValidation /Users/josh/src/lsstgit/ci_hsc/DATA --id ccd=16 visit=903986 root INFO: Validating dataset bias for {'ccd': 16, 'visit': 903986} CameraMapper INFO: Unable to locate calibRegistry registry in root: calibRegistry.sqlite3 CameraMapper INFO: Unable to locate calibRegistry registry in current dir: ./calibRegistry.sqlite3 CameraMapper INFO: Loading Posix registry from /Users/josh/src/lsstgit/ci_hsc/DATA/CALIB Traceback (most recent call last): File "/Users/josh/src/lsstgit/ci_hsc/bin/validate.py", line 4, in <module> main() File "/Users/josh/src/lsstgit/ci_hsc/python/lsst/ci/hsc/validate.py", line 53, in main validator.run(dataId) File "/Users/josh/src/lsstgit/ci_hsc/python/lsst/ci/hsc/validate.py", line 151, in run self.validateDataset(dataId, ds) File "/Users/josh/src/lsstgit/ci_hsc/python/lsst/ci/hsc/validate.py", line 114, in validateDataset self.assertTrue("%s exists" % dataset, self.butler.datasetExists(datasetType=dataset, dataId=dataId)) File "/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/butler.py", line 826, in datasetExists location = repoData.repo.map(datasetType, dataId) File "/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/repository.py", line 241, in map loc = self._mapper.map(*args, **kwargs) File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_subaru/13.0-7-g4173d19+1/python/lsst/obs/hsc/hscMapper.py", line 158, in map location = super(HscMapper, self).map(datasetType, copyId, write=write) File "/Users/josh/src/lsstsw/stack/DarwinX86/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/mapper.py", line 167, in map return func(self.validate(dataId), write) File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_base/13.0-6-g634eb8b/python/lsst/obs/base/cameraMapper.py", line 369, in mapClosure return mapping.map(mapper, dataId, write) File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_base/13.0-6-g634eb8b/python/lsst/obs/base/mapping.py", line 124, in map actualId = self.need(iter(self.keyDict.keys()), dataId) File "/Users/josh/src/lsstsw/stack/DarwinX86/obs_base/13.0-6-g634eb8b/python/lsst/obs/base/mapping.py", line 262, in need self.datasetType, dataId) lsst.daf.persistence.butlerExceptions.NoResults: No unique lookup for [u'calibDate'] from DataId(initialdata={'ccd': 16, 'visit': 903986}, tag=set([])): 0 matches datasetType:bias dataId:DataId(initialdata={'ccd': 16, 'visit': 903986}, tag=set([])) scons: *** [.scons/calibValidation-903986-16] Error 1 scons: building terminated because of errors.
            Hide
            jmeyers314 Joshua Meyers added a comment -

            Hsin-Fang Chiang and Paul Price suggested that I remove the corrupted DATA directory before trying to run again. That seems to have solved my issue. Runs just fine now.

            Show
            jmeyers314 Joshua Meyers added a comment - Hsin-Fang Chiang and Paul Price suggested that I remove the corrupted DATA directory before trying to run again. That seems to have solved my issue. Runs just fine now.
            Hide
            jmeyers314 Joshua Meyers added a comment -

            Solved by DM-9848.

            Show
            jmeyers314 Joshua Meyers added a comment - Solved by DM-9848 .

              People

              • Assignee:
                Unassigned
                Reporter:
                jmeyers314 Joshua Meyers
                Watchers:
                Frossie Economou, Hsin-Fang Chiang, John Swinbank, Joshua Meyers, Nate Pease, Paul Price, Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel