Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4181

Butler: add support for skymap based dataIds

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: butler
    • Labels:
      None

      Description

      load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

      will be something like:
      create a skymap object given a configuration (in the repository) (it has its own dataset type)
      create a registry with that skymap object
      use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

      requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

      example use case:

      {
      		 
          datasetType = 'coaddTempExp'
      		 
          key = (?)
      		 
          format = ['patch', 'visit']
      		 
          dataId = {'tract':<some numberOrId>}
      		 
          myButler.queryMetadata(datasetType, key, format, dataId)
      		 
      }

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-3472 Implement Basic spatial lookups for the Butler

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-4532 define and implement mechanism to iterate over partial dataIds

          • Won't Fix
          mentioned in

          Page Loading...

          Page Loading...

          Page Loading...

          Page Loading...

            Activity

            Ascending order - Click to sort in descending order
            npease Nate Pease [X] (Inactive) created issue -
            frossie Frossie Economou made changes -
            Field Original Value New Value
            Component/s butler [ 12317 ]
            Team Data Access and Database [ 10204 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            jbosch Jim Bosch made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            jbosch Jim Bosch made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Description load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.
            		load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {{datasetType = 'coaddTempExp'
            key = (?)
            format = ['patch', 'visit']
            dataId = {'tract':<some numberOrId>}
            myButler.queryMetadata(datasetType, key, format, dataId)}}
            npease Nate Pease [X] (Inactive) made changes -
            Description load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {{datasetType = 'coaddTempExp'
            key = (?)
            format = ['patch', 'visit']
            dataId = {'tract':<some numberOrId>}
            myButler.queryMetadata(datasetType, key, format, dataId)}}
            		load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {{datasetType = 'coaddTempExp'
            key = (?)
            format = ['patch', 'visit']
            dataId = {'tract':<some numberOrId>}
            myButler.queryMetadata(datasetType, key, format, dataId)
            }}
            npease Nate Pease [X] (Inactive) made changes -
            Description load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {{datasetType = 'coaddTempExp'
            key = (?)
            format = ['patch', 'visit']
            dataId = {'tract':<some numberOrId>}
            myButler.queryMetadata(datasetType, key, format, dataId)
            }}             		load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {{
            datasetType = 'coaddTempExp'
            key = (?)
            format = ['patch', 'visit']
            dataId = {'tract':<some numberOrId>}
            myButler.queryMetadata(datasetType, key, format, dataId)
            }}
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            npease Nate Pease [X] (Inactive) made changes -
            Link This issue relates to DM-4532 [ DM-4532 ]
            rhl Robert Lupton made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13228 ] This issue links to "Page (Confluence)" [ 13228 ]
            jbecla Jacek Becla made changes -
            Rank Ranked higher
            jbecla Jacek Becla made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13256 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13256 ] This issue links to "Page (Confluence)" [ 13256 ]
            ktl Kian-Tat Lim made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13256 ] This issue links to "Page (Confluence)" [ 13256 ]
            ktl Kian-Tat Lim made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13256 ] This issue links to "Page (Confluence)" [ 13256 ]
            ktl Kian-Tat Lim made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13256 ] This issue links to "Page (Confluence)" [ 13256 ]
            xiuqin Xiuqin Wu [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            jbecla Jacek Becla made changes -
            Description load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {{
            datasetType = 'coaddTempExp'
            key = (?)
            format = ['patch', 'visit']
            dataId = {'tract':<some numberOrId>}
            myButler.queryMetadata(datasetType, key, format, dataId)
            }}             		load the skymap from the repository and use it a la metadata lookup to complete lookups. for example if the script wants all the patches that are in tract x, look in the skymap to get that information.

            will be something like:
            create a skymap object given a configuration (in the repository) (it has its own dataset type)
            create a registry with that skymap object
            use that registry to lookup skymap related parameters. Might need to add to the policy file that a given configuration uses the skymap.

            requires that data is already indexable by tract & patch, the work is adds iteration over tract/patch specified by the skymap.

            example use case:
            {code}
            {
                datasetType = 'coaddTempExp'
                key = (?)
                format = ['patch', 'visit']
                dataId = {'tract':<some numberOrId>}
                myButler.queryMetadata(datasetType, key, format, dataId)
            }
            {code}
            jbecla Jacek Becla made changes -
            Link This issue relates to DM-3472 [ DM-3472 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            jbecla Jacek Becla made changes -
            Epic Link DM-4341 [ 21422 ]
            jbecla Jacek Becla made changes -
            Story Points 15
            jbecla Jacek Becla made changes -
            Rank Ranked higher
            jbecla Jacek Becla made changes -
            Rank Ranked higher
            jbecla Jacek Becla made changes -
            Rank Ranked higher
            jbecla Jacek Becla made changes -
            Rank Ranked higher
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            npease Nate Pease [X] (Inactive) made changes -
            Rank Ranked higher
            npease Nate Pease [X] (Inactive) made changes -
            Rank Ranked higher
            npease Nate Pease [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 13260 ] This issue links to "Page (Confluence)" [ 13260 ]
            fritzm Fritz Mueller made changes -
            Rank Ranked lower
            npease Nate Pease [X] (Inactive) made changes -
            Epic Link DM-4341 [ 21422 ] DM-6047 [ 24358 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-6047 [ 24358 ] DM-4341 [ 21422 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-4341 [ 21422 ] DM-6047 [ 24358 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-6047 [ 24358 ] DM-4340 [ 21421 ]
            fritzm Fritz Mueller made changes -
            Sprint DB_S17_12 [ 304 ]
            fritzm Fritz Mueller made changes -
            Sprint DB_S17_12 [ 304 ] DB_S17_01 [ 307 ]
            fritzm Fritz Mueller made changes -
            Rank Ranked higher
            fritzm Fritz Mueller made changes -
            Rank Ranked lower
            fritzm Fritz Mueller made changes -
            Sprint DB_S17_01 [ 307 ]
            fritzm Fritz Mueller made changes -
            Rank Ranked higher
            fritzm Fritz Mueller made changes -
            Epic Link DM-4340 [ 21421 ] DM-10678 [ 32630 ]
            fritzm Fritz Mueller made changes -
            Rank Ranked higher
            fritzm Fritz Mueller made changes -
            Rank Ranked higher
            fritzm Fritz Mueller made changes -
            Epic Link DM-10678 [ 32630 ] DM-12759 [ 36358 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 29416 ]
            tjenness Tim Jenness made changes -
            Resolution Done [ 10000 ]
            Status To Do [ 10001 ] Won't Fix [ 10405 ]

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              npease Nate Pease [X] (Inactive)
              Watchers:
              Hsin-Fang Chiang, Jim Bosch, Nate Pease [X] (Inactive), Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.