Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21254

DRP efforts toward Gen 3 Middleware: PipelineTask Conversion F19b

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      f19b-drp-pipelineTask
    • Story Points:
      135
    • WBS:
      02C.04.01
    • Team:
      Data Release Production
    • Cycle:
      Fall 2019

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      DM-22073

      Add matplotlib (output) support to Gen3 butler

      1 Lee Kelvin Done
       
      DM-22068

      Add ABC, StorageClass, and Formatter for stray-light correction

      1 Jim Bosch Done
       
      DM-22062

      Add parquet support to Gen3 Butler

      2 Jim Bosch Done
       
      DM-22108

      Gen3 ip_isr raises if 'defects' not supplied in inputs

      1 Christopher Waters Done
       
      DM-22253

      Audit usage of butler.get() in pipe_analysis scripts

      2 Lauren MacArthur Done
       
      DM-21454

      Foreign key error when running makeButlerRepo.py against Oracle

      3 Jim Bosch Done
       
      DM-21451

      Remove DatabaseDict and vectorize Datastore/Butler ingest APIs

      3 Jim Bosch Done
       
      DM-21448

      Clean up DatasetRef comparisons and immutability

      4 Jim Bosch Done
       
      DM-21429

      Stop S3-backed butler tests from attempting import/export

      0.5 Jim Bosch Done
       
      DM-21421

      Create a system to define pipeline level execution and configuration

      20 Nate Lust Done
       
      DM-21410

      Turn ci_hsc into a metapackage for ci_hsc_gen2 and ci_hsc_gen3

      1 Jim Bosch Done
       
      DM-21351

      Move pipe_base tests to obs_test to normalize dependencies

      0.5 Jim Bosch Done
       
      DM-21795

      Rework Registry provenance objects to match prototype

      2 Jim Bosch Done
       
      DM-21739

      Enable fringe and HSC y-band stray light correction in Gen3 IsrTask

      8 Christopher Waters Done
       
      DM-21859

      Multiple PrerequisiteInput quanta are clobbered by a single value.

      2 Christopher Waters Done
       
      DM-21843

      pipetask runner fails at constructing qgraph dot files

      0.5 Jim Bosch Done
       
      DM-21836

      Add OBSTYPE/purpose to Gen3 Registry exposure table

      1 Jim Bosch Done
       
      DM-22487

      Prototype Registry architecture for schema changes and (eventually) multiple layers

      8 Jim Bosch Done
       
      DM-22485

      Fix docstring heading to make example appear

      0.5 Jim Bosch Done
       
      DM-16803

      Refactor ci_hsc build scripts for better Gen3 testing

      2 Jim Bosch Won't Fix
       
      DM-17154

      Move Registry schema definition from YAML to Python

      2 Jim Bosch Invalid
       
      DM-17498

      Devise interim solution for "expected missing" data products in PipelineTask execution

      2 Unassigned Invalid
       
      DM-19851

      Improve multi-collection query in QuantumGraph generator

      2 Andy Salnikov Invalid
       
      DM-14816

      Convert all concrete CmdLineTasks to PipelineTasks

      0 Jim Bosch Invalid
       
      DM-15411

      Move gen2convert subpackage out of daf_butler

      Jim Bosch Invalid
       
      DM-13990

      Add support for different SkyPix systems to Registry DataUnit schema

      8 Jim Bosch Invalid

        Activity

        No builds found.
        yusra Yusra AlSayyad created issue -
        yusra Yusra AlSayyad made changes -
        Field Original Value New Value
        Epic Child DM-15466 [ 178759 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-19807 [ 293954 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-14816 [ 126055 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-15750 [ 201291 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-15411 [ 168517 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17154 [ 238910 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-15749 [ 201290 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17498 [ 239376 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17017 [ 238492 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-16056 [ 223676 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-19942 [ 305955 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-16803 [ 236849 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-20014 [ 311524 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17062 [ 238688 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-12650 [ 36201 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-19851 [ 297340 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-15412 [ 168522 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17689 [ 239741 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-12651 [ 36203 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-13990 [ 39832 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-16876 [ 238171 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21351 [ 422428 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21370 [ 422850 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21410 [ 422971 ]
        nlust Nate Lust made changes -
        Epic Child DM-21421 [ 422996 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21429 [ 423019 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21448 [ 423062 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21451 [ 423077 ]
        swinbank John Swinbank made changes -
        Story Points 135
        jbosch Jim Bosch made changes -
        Epic Child DM-15750 [ 201291 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-15749 [ 201290 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-15466 [ 178759 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21739 [ 424699 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21764 [ 424741 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21766 [ 424743 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21768 [ 424745 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21770 [ 424747 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21773 [ 424750 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21774 [ 424751 ]
        swinbank John Swinbank made changes -
        Epic Child DM-21454 [ 423096 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21794 [ 424796 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21795 [ 424799 ]
        swinbank John Swinbank made changes -
        Status To Do [ 10001 ] In Progress [ 3 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21836 [ 425087 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21840 [ 425093 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21843 [ 425100 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21849 [ 425111 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21850 [ 425112 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21854 [ 425120 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-21855 [ 425121 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-22062 [ 425670 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-22068 [ 425686 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-22073 [ 425731 ]
        swinbank John Swinbank made changes -
        Epic Child DM-21859 [ 425125 ]
        lauren Lauren MacArthur made changes -
        Epic Child DM-22253 [ 426556 ]
        sophiereed Sophie Reed made changes -
        Epic Child DM-22255 [ 426569 ]
        lauren Lauren MacArthur made changes -
        Epic Child DM-22266 [ 426614 ]
        swinbank John Swinbank made changes -
        Epic Child DM-22286 [ 426698 ]
        swinbank John Swinbank made changes -
        Epic Child DM-22302 [ 426768 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-22485 [ 427329 ]
        jbosch Jim Bosch made changes -
        Epic Child DM-22487 [ 427338 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21212 [ 410710 ]
        swinbank John Swinbank made changes -
        Epic Child DM-22527 [ 427427 ]
        swinbank John Swinbank made changes -
        Epic Child DM-22534 [ 427443 ]
        swinbank John Swinbank made changes -
        Epic Child DM-22108 [ 425883 ]
        swinbank John Swinbank made changes -
        Epic Child DM-21855 [ 425121 ]
        czw Christopher Waters made changes -
        Epic Child DM-21212 [ 410710 ]
        czw Christopher Waters made changes -
        Epic Child DM-22534 [ 427443 ]
        czw Christopher Waters made changes -
        Epic Child DM-22527 [ 427427 ]
        czw Christopher Waters made changes -
        Epic Child DM-22302 [ 426768 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-15412 [ 168522 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21770 [ 424747 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21370 [ 422850 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21854 [ 425120 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21850 [ 425112 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21773 [ 424750 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-20014 [ 311524 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21840 [ 425093 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17062 [ 238688 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21768 [ 424745 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21764 [ 424741 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-22255 [ 426569 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-12650 [ 36201 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-16876 [ 238171 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21766 [ 424743 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-22266 [ 426614 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-22286 [ 426698 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-12651 [ 36203 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21774 [ 424751 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21794 [ 424796 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-19942 [ 305955 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-19807 [ 293954 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-21849 [ 425111 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17017 [ 238492 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-16056 [ 223676 ]
        yusra Yusra AlSayyad made changes -
        Epic Child DM-17689 [ 239741 ]
        yusra Yusra AlSayyad made changes -
        Resolution Done [ 10000 ]
        Status In Progress [ 3 ] Done [ 10002 ]

          People

          Assignee:
          Unassigned Unassigned
          Reporter:
          yusra Yusra AlSayyad
          Watchers:
          Yusra AlSayyad
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

            Dates

            Created:
            Updated:
            Resolved:

              Summary Panel

                CI Builds

                No builds found.