Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9908

butler is unable to read data that exists in the registry

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Story Points:
      1
    • Sprint:
      DB_S17_2, DB_S17_4, DB_S17_5, DB_S17_6, DB_S17_7, DB_S17_8, DB_S17_9
    • Team:
      Data Access and Database

      Description

      Using daf_persistence 13.0-5-g87674b4 (w_2017_12) in Princeton I get an error; I cannot test this at lsst-dev as w_2017_11 doesn't seem to be installed. The paths are correct for lsst-dev, however, so you should be able to repeat this there.

      The error is:

      import lsst.daf.persistence as dafPersist
      butler = dafPersist.Butler("/datasets/comCam/repo")
      r = butler.get('raw', run='4672D', ccd='S00', visit=261576101)
       
      ---------------------------------------------------------------------------
      NoResults
                                       Traceback (most recent call last)
       
      <ipython-input-9-ac5a11c0f585> in <module>()
            1 butler = dafPersist.Butler("/tigress/HSC/LSST/comCam")
      ----> 2 r = butler.get('raw', run='4672D', ccd='S00', visit=261576101)
       
       
       
      /tigress/HSC/LSST/stack/Linux64/daf_persistence/13.0-5-g87674b4/python/lsst/daf/persistence/butler.pyc in get(self, datasetType, dataId, immediate, **rest)
          943         location = self._locate(datasetType, dataId, write=False)
          944         if location is None:
      --> 945             raise NoResults("No locations for get:", datasetType, dataId)
          946         self.log.debug("Get type=%s keys=%s from %s", datasetType, dataId, str(location))
          947 
       
       
       
      NoResults
      : No locations for get: datasetType:raw dataId:DataId(initialdata={'ccd': 'S00', 'run': '4672D', 'visit': 261576101}, tag=set([]))
      

      But if I query the registry directly I see my data; using dat_persistence 13.0-3-gc00b09a also seems to work.

      $ sqlite3 /tigress/HSC/LSST/comCam/registry.sqlite3 
      SQLite version 3.9.2 2015-11-02 18:31:45
      Enter ".help" for usage hints.
      sqlite> select visit from raw where ccd='S01' and run = '4672D' and visit = 261576101;
      261576101
      

        Attachments

          Container Issues

            Activity

              People

              • Assignee:
                rhl Robert Lupton
                Reporter:
                rhl Robert Lupton
                Reviewers:
                Robert Lupton
                Watchers:
                Kian-Tat Lim, Nate Pease, Robert Lupton
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel