Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13992

Modify concrete CmdLineTasks and Gen3 Butler as necessary to work together

    Details

      Description

      While the basic get and put interface should be backwards-compatible, some things CmdLineTasks do are not currently planned to be implemented in Gen3 in a way that looks the same as Gen2:

      • Slicing Datasets (i.e. retrieving subimages)
      • Subsets and incomplete data IDs
      • DataRefs

      When possible, add (temporary) shims to daf_butler to make things work the same way.  When it's less messy to add special-case code to the CmdLineTasks themselves, do that instead (which should be rare).

      This ticket will focus on the easiest steps of the pipeline included in ci_hsc: the CmdLineTasks defined in pipe/tasks/multiBand.py.  Those will be run against a Gen3 repo build by converting a Gen2 repo containing the outputs of all previous steps.

        Attachments

          Activity

          Hide
          jbosch Jim Bosch added a comment -

          Since we're trying to build a complete shim on DM-14003, it's not clear we'll actually need to make any modifications to CmdLineTasks to get them working.  I'm removing this from the current sprint, but I'll keep it around until we know how well the shim works.

          Show
          jbosch Jim Bosch added a comment - Since we're trying to build a complete shim on DM-14003 , it's not clear we'll actually need to make any modifications to CmdLineTasks to get them working.  I'm removing this from the current sprint, but I'll keep it around until we know how well the shim works.
          Hide
          jbosch Jim Bosch added a comment -

          We are taking a totally different approach to the transition: only PipelineTasks will use Gen3 Butler, but PiplineTasks will coexist with their CmdLineTask variants.

           

          Show
          jbosch Jim Bosch added a comment - We are taking a totally different approach to the transition: only PipelineTasks will use Gen3 Butler, but PiplineTasks will coexist with their CmdLineTask variants.  

            People

            • Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel