Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4927

ci_hsc doesn't produce readable processCcd_metadata

    Details

    • Type: Story
    • Status: Invalid
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ci_hsc
    • Labels:
      None
    • Templates:
    • Team:
      Architecture

      Description

      When I run scons in ci_hsc, it fails as follows:

      partial([".scons/sfm-903334-16"], ["DATA/registry.sqlite3", "DATA/CALIB", ".scons/sfm"])
      : Validating dataset processCcd_config for {'ccd': 16, 'visit': 903334}
      CameraMapper: Loading registry registry from /raid/swinbank/src/ci_hsc/DATA/registry.sqlite3
      CameraMapper: Loading calibRegistry registry from /raid/swinbank/src/ci_hsc/DATA/CALIB/calibRegistry.sqlite3
      : processCcd_config exists: PASS
      : processCcd_config readable (<class 'lsst.pipe.tasks.processCcd.ProcessCcdConfig'>): PASS
      : Validating dataset processCcd_metadata for {'ccd': 16, 'visit': 903334}
      : processCcd_metadata exists: PASS
      scons: *** [.scons/sfm-903334-16] Exception : input stream error
      Traceback (most recent call last):
        File "/nfs/home/lsstsw/stack/Linux64/scons/2.3.0+1/lib/scons/SCons/Action.py", line 1062, in execute
          result = self.execfunction(target=target, source=rsources, env=env)
        File "/raid/swinbank/src/ci_hsc/python/lsst/ci/hsc/validate.py", line 116, in scons
          return self.run(*args, **kwargs)
        File "/raid/swinbank/src/ci_hsc/python/lsst/ci/hsc/validate.py", line 92, in run
          self.validateDataset(dataId, ds)
        File "/raid/swinbank/src/ci_hsc/python/lsst/ci/hsc/validate.py", line 67, in validateDataset
          print(data.__class__)
        File "/home/lsstsw/stack/Linux64/daf_persistence/2015_10.0-6-g5a5f333+5/python/lsst/daf/persistence/readProxy.py", line 41, in __getattribute__
          subject = oga(self, '__subject__')
        File "/home/lsstsw/stack/Linux64/daf_persistence/2015_10.0-6-g5a5f333+5/python/lsst/daf/persistence/readProxy.py", line 136, in __subject__
          set_cache(self, get_callback(self)())
        File "/home/lsstsw/stack/Linux64/daf_persistence/2015_10.0-6-g5a5f333+5/python/lsst/daf/persistence/butler.py", line 279, in <lambda>
          callback = lambda: self._read(pythonType, location)
        File "/home/lsstsw/stack/Linux64/daf_persistence/2015_10.0-6-g5a5f333+5/python/lsst/daf/persistence/butler.py", line 452, in _read
          location.getCppType(), storageList, additionalData)
        File "/home/lsstsw/stack/Linux64/daf_persistence/2015_10.0-6-g5a5f333+5/python/lsst/daf/persistence/persistenceLib.py", line 1430, in unsafeRetrieve
          return _persistenceLib.Persistence_unsafeRetrieve(self, *args)
      Exception: input stream error
      scons: building terminated because of errors.
      

        Attachments

        1. 0903334-016.boost
          56 kB
          John Swinbank
        2. 0903334-016.xml
          129 kB
          John Swinbank
        3. testPersist.py
          0.6 kB
          John Swinbank

          Container Issues

            Issue Links

              Activity

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  swinbank John Swinbank
                  Watchers:
                  Colin Slater, Jim Bosch, John Swinbank, Kian-Tat Lim, Michael Wood-Vasey, Paul Price, Vishal Kasliwal [X] (Inactive)
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  7 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Summary Panel