Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21254

DRP efforts toward Gen 3 Middleware: PipelineTask Conversion F19b

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      f19b-drp-pipelineTask
    • Story Points:
      135
    • WBS:
      02C.04.01
    • Team:
      Data Release Production
    • Cycle:
      Fall 2019

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      DM-22253

      Audit usage of butler.get() in pipe_analysis scripts

      2 Lauren MacArthur Done
       
      DM-22108

      Gen3 ip_isr raises if 'defects' not supplied in inputs

      1 Christopher Waters Done
       
      DM-21454

      Foreign key error when running makeButlerRepo.py against Oracle

      3 Jim Bosch Done
       
      DM-21451

      Remove DatabaseDict and vectorize Datastore/Butler ingest APIs

      3 Jim Bosch Done
       
      DM-21448

      Clean up DatasetRef comparisons and immutability

      4 Jim Bosch Done
       
      DM-21429

      Stop S3-backed butler tests from attempting import/export

      0.5 Jim Bosch Done
       
      DM-21421

      Create a system to define pipeline level execution and configuration

      20 Nate Lust Done
       
      DM-21410

      Turn ci_hsc into a metapackage for ci_hsc_gen2 and ci_hsc_gen3

      1 Jim Bosch Done
       
      DM-21351

      Move pipe_base tests to obs_test to normalize dependencies

      0.5 Jim Bosch Done
       
      DM-22487

      Prototype Registry architecture for schema changes and (eventually) multiple layers

      8 Jim Bosch Done
       
      DM-22485

      Fix docstring heading to make example appear

      0.5 Jim Bosch Done
       
      DM-21843

      pipetask runner fails at constructing qgraph dot files

      0.5 Jim Bosch Done
       
      DM-21836

      Add OBSTYPE/purpose to Gen3 Registry exposure table

      1 Jim Bosch Done
       
      DM-21795

      Rework Registry provenance objects to match prototype

      2 Jim Bosch Done
       
      DM-21739

      Enable fringe and HSC y-band stray light correction in Gen3 IsrTask

      8 Christopher Waters Done
       
      DM-21859

      Multiple PrerequisiteInput quanta are clobbered by a single value.

      2 Christopher Waters Done
       
      DM-22073

      Add matplotlib (output) support to Gen3 butler

      1 Lee Kelvin Done
       
      DM-22068

      Add ABC, StorageClass, and Formatter for stray-light correction

      1 Jim Bosch Done
       
      DM-22062

      Add parquet support to Gen3 Butler

      2 Jim Bosch Done
       
      DM-16803

      Refactor ci_hsc build scripts for better Gen3 testing

      2 Jim Bosch Won't Fix
       
      DM-19851

      Improve multi-collection query in QuantumGraph generator

      2 Andy Salnikov Invalid
       
      DM-17498

      Devise interim solution for "expected missing" data products in PipelineTask execution

      2 Unassigned Invalid
       
      DM-17154

      Move Registry schema definition from YAML to Python

      2 Jim Bosch Invalid
       
      DM-15411

      Move gen2convert subpackage out of daf_butler

      Jim Bosch Invalid
       
      DM-14816

      Convert all concrete CmdLineTasks to PipelineTasks

      0 Jim Bosch Invalid
       
      DM-13990

      Add support for different SkyPix systems to Registry DataUnit schema

      8 Jim Bosch Invalid

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            yusra Yusra AlSayyad
            Watchers:
            Yusra AlSayyad
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Summary Panel