Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4180

Butler: provide API so that a task can define the output dataset type

    XMLWordPrintable

Details

    • Story
    • Status: Won't Fix
    • Resolution: Done
    • None
    • butler
    • None

    Description

      The task needs to be able to specify everything that needs to be in the policy file so that the butler can put and get data for a new dataset type.

      Consider that the policy data can be split between the camera-specific and the task-specific parts. (KT was thinking of calling the camera part the "genre"), this potentially reduces the amount the task has to specify.
      Another option is to hard-code some some of the policy in the butler itself:

      • the path template (it could be assembled out of the data id components)
        • if it's hard coded the task must pass the component dataId keys
        • if it's not hard coded the task must provide a template
      • python type
      • storage type

      there could be user overrides too.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              npease Nate Pease [X] (Inactive)
              Gregory Dubois-Felsmann, Hsin-Fang Chiang, Nate Pease [X] (Inactive), Russell Owen, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.