Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21254

DRP efforts toward Gen 3 Middleware: PipelineTask Conversion F19b

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      f19b-drp-pipelineTask
    • Story Points:
      135
    • WBS:
      02C.04.01
    • Team:
      Data Release Production
    • Cycle:
      Fall 2019

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      		DM-22253

      Audit usage of butler.get() in pipe_analysis scripts

      		 2 Lauren MacArthur Done
       
      		DM-22487

      Prototype Registry architecture for schema changes and (eventually) multiple layers

      		 8 Jim Bosch Done
       
      		DM-22485

      Fix docstring heading to make example appear

      		 0.5 Jim Bosch Done
       
      		DM-22073

      Add matplotlib (output) support to Gen3 butler

      		 1 Lee Kelvin Done
       
      		DM-22068

      Add ABC, StorageClass, and Formatter for stray-light correction

      		 1 Jim Bosch Done
       
      		DM-22062

      Add parquet support to Gen3 Butler

      		 2 Jim Bosch Done
       
      		DM-21739

      Enable fringe and HSC y-band stray light correction in Gen3 IsrTask

      		 8 Christopher Waters Done
       
      		DM-21410

      Turn ci_hsc into a metapackage for ci_hsc_gen2 and ci_hsc_gen3

      		 1 Jim Bosch Done
       
      		DM-21421

      Create a system to define pipeline level execution and configuration

      		 20 Nate Lust Done
       
      		DM-21795

      Rework Registry provenance objects to match prototype

      		 2 Jim Bosch Done
       
      		DM-21454

      Foreign key error when running makeButlerRepo.py against Oracle

      		 3 Jim Bosch Done
       
      		DM-21451

      Remove DatabaseDict and vectorize Datastore/Butler ingest APIs

      		 3 Jim Bosch Done
       
      		DM-21448

      Clean up DatasetRef comparisons and immutability

      		 4 Jim Bosch Done
       
      		DM-21429

      Stop S3-backed butler tests from attempting import/export

      		 0.5 Jim Bosch Done
       
      		DM-22108

      Gen3 ip_isr raises if 'defects' not supplied in inputs

      		 1 Christopher Waters Done
       
      		DM-21859

      Multiple PrerequisiteInput quanta are clobbered by a single value.

      		 2 Christopher Waters Done
       
      		DM-21843

      pipetask runner fails at constructing qgraph dot files

      		 0.5 Jim Bosch Done
       
      		DM-21836

      Add OBSTYPE/purpose to Gen3 Registry exposure table

      		 1 Jim Bosch Done
       
      		DM-21351

      Move pipe_base tests to obs_test to normalize dependencies

      		 0.5 Jim Bosch Done
       
      		DM-16803

      Refactor ci_hsc build scripts for better Gen3 testing

      		 2 Jim Bosch Won't Fix
       
      		DM-17154

      Move Registry schema definition from YAML to Python

      		 2 Jim Bosch Invalid
       
      		DM-19851

      Improve multi-collection query in QuantumGraph generator

      		 2 Andy Salnikov Invalid
       
      		DM-17498

      Devise interim solution for "expected missing" data products in PipelineTask execution

      		 2 Unassigned Invalid
       
      		DM-15411

      Move gen2convert subpackage out of daf_butler

      		 Jim Bosch Invalid
       
      		DM-14816

      Convert all concrete CmdLineTasks to PipelineTasks

      		 0 Jim Bosch Invalid
       
      		DM-13990

      Add support for different SkyPix systems to Registry DataUnit schema

      		 8 Jim Bosch Invalid

        Activity

        There are no comments yet on this issue.

          People

          Assignee:
          Unassigned Unassigned
          Reporter:
          yusra Yusra AlSayyad
          Watchers:
          Yusra AlSayyad
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

            Dates

            Created:
            Updated:
            Resolved:

              Jenkins

              No builds found.