Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12595

Failure to load configs when processing HSC data

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: obs_subaru
    • Labels:
      None
    • Templates:
    • Team:
      External

      Description

      When attempting to create a butler object with a stack newer than w_2017_43, I see the following error:

      In [2]: repoN = Butler('/datasets/hsc/repo/rerun/private/nate/addFakesCoaddTest')
      CameraMapper INFO: Loading exposure registry from /datasets/hsc/repo/registry.sqlite3
      CameraMapper INFO: Loading calib registry from /datasets/hsc/repo/CALIB/calibRegistry.sqlite3
      ---------------------------------------------------------------------------
      AttributeError                            Traceback (most recent call last)
      <ipython-input-2-7580970a312d> in <module>()
      ----> 1 repoN = Butler('/datasets/hsc/repo/rerun/private/nate/addFakesCoaddTest')
       
      /software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/daf_persistence/14.0-11-g0362164+2/python/lsst/daf/persistence/butler.py in __init__(self, root, mapper, inputs, outputs, **mapperArgs)
          535         for repoData in reversed(repoDataList):
          536             self._setParentRegistry(repoData)
      --> 537             repoData.repo = Repository(repoData)
          538 
          539     def _setParentRegistry(self, repoData):
       
      /software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/daf_persistence/14.0-11-g0362164+2/python/lsst/daf/persistence/repository.py in __init__(self, repoData)
          141             self._storage.putRepositoryCfg(repoData.cfg, repoData.cfgRoot)
          142         self._mapperArgs = repoData.cfg.mapperArgs  # keep for reference in matchesArgs
      --> 143         self._initMapper(repoData)
          144 
          145     def _initMapper(self, repoData):
       
      /software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/daf_persistence/14.0-11-g0362164+2/python/lsst/daf/persistence/repository.py in _initMapper(self, repoData)
          170             mapper = mapper(parentRegistry=repoData.parentRegistry,
          171                             repositoryCfg=repoData.cfg,
      --> 172                             **mapperArgs)
          173         self._mapper = mapper
          174 
       
      /software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/obs_subaru/14.0-10-g69a8e8f2+2/python/lsst/obs/hsc/hscMapper.py in __init__(self, **kwargs)
           36             calibSearch = [os.path.join(kwargs['root'], 'CALIB')]
           37             if "repositoryCfg" in kwargs:
      ---> 38                 calibSearch += [os.path.join(cfg.root, 'CALIB') for cfg in kwargs["repositoryCfg"].parents]
           39                 calibSearch += [cfg.root for cfg in kwargs["repositoryCfg"].parents]
           40             for calibRoot in calibSearch:
       
      /software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/obs_subaru/14.0-10-g69a8e8f2+2/python/lsst/obs/hsc/hscMapper.py in <listcomp>(.0)
           36             calibSearch = [os.path.join(kwargs['root'], 'CALIB')]
           37             if "repositoryCfg" in kwargs:
      ---> 38                 calibSearch += [os.path.join(cfg.root, 'CALIB') for cfg in kwargs["repositoryCfg"].parents]
           39                 calibSearch += [cfg.root for cfg in kwargs["repositoryCfg"].parents]
           40             for calibRoot in calibSearch:
       
      AttributeError: 'str' object has no attribute 'root'
      

      This seems to be related to DM-12117 but is not the same issue.

      The changes that introduce the HSC failure come from this commit.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                price Paul Price
                Reporter:
                nlust Nate Lust
                Reviewers:
                Nate Lust
                Watchers:
                Nate Lust, Paul Price, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel