Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4181

Butler: add support for skymap based dataIds

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: butler
    • Labels:
      None

      Description

      load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

      will be something like:
      create a skymap object given a configuration (in the repository) (it has its own dataset type)
      create a registry with that skymap object
      use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

      requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

      example use case:

      {
          datasetType = 'coaddTempExp'
          key = (?)
          format = ['patch', 'visit']
          dataId = {'tract':<some numberOrId>}
          myButler.queryMetadata(datasetType, key, format, dataId)
      }
      

        Attachments

          Issue Links

            Activity

            Hide
            jbosch Jim Bosch added a comment -

            I don't think we can get away with hard-coding the skymap configuration in the mapper policy file, at least as those policy files stand now; each camera needs to be able to support multiple skymap configurations (though not within the same data repository).

            Show
            jbosch Jim Bosch added a comment - I don't think we can get away with hard-coding the skymap configuration in the mapper policy file, at least as those policy files stand now; each camera needs to be able to support multiple skymap configurations (though not within the same data repository).
            Hide
            tjenness Tim Jenness added a comment -

            Gen 2 is deprecated and Gen3 handles skymaps in its own way.

            Show
            tjenness Tim Jenness added a comment - Gen 2 is deprecated and Gen3 handles skymaps in its own way.

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              npease Nate Pease [X] (Inactive)
              Watchers:
              Hsin-Fang Chiang, Jim Bosch, Nate Pease [X] (Inactive), Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.