Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22633

AP pipeline infrastructure in S20A

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      s20a-ap-infrastructure
    • Story Points:
      160
    • WBS:
      02C.03.05
    • Team:
      Alert Production
    • Cycle:
      Spring 2020

      Description

      This epic includes AP work in S20A dedicated to:

      • Science Data Model standardization;
      • Upgrades to the Exposure class and related code;
      • Support for “Generation 3” middleware.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        		DM-22648

        Add DcrModel to Gen3 butler

        		4 Ian Sullivan Done
         
        		DM-22505

        Create run method in ImageDifferenceTask and move all functionality from runDataRef except butler usage

        		6 Gabor Kovacs [X] (Inactive) Done
         
        		DM-23008

        Add DCR model subfilters to Gen3 registry

        		5 Ian Sullivan Done
         
        		DM-22482

        Write up design sketch on Gen3 calibration product handling

        		4 John Parejko Done
         
        		DM-22478

        Lightly restructure ap_association tasks and create new DiaObject/DiaSource pre-loading task.

        		6 Chris Morrison [X] (Inactive) Done
         
        		DM-22708

        Fix decam gen3 ingest

        		8 John Parejko Done
         
        		DM-21917

        Convert DCR templates to PipelineTasks

        		8 Ian Sullivan Done
         
        		DM-21912

        Implement PpdbMetricTask.runQuantum

        		1 Krzysztof Findeisen Done
         
        		DM-21911

        Retrofit Gen 3 functionality onto MetricTask

        		4 Krzysztof Findeisen Done
         
        		DM-21886

        Create PipelineTask driver for ap_pipe tasks that interact with the APDB

        		8 Chris Morrison [X] (Inactive) Done
         
        		DM-21885

        Convert concrete MetricTasks to PipelineTasks

        		0 Krzysztof Findeisen Done
         
        		DM-23140

        Announce ip_diffim Gen3 transition plan on CLO

        		1 Gabor Kovacs [X] (Inactive) Done
         
        		DM-23139

        Check whether the gen3 butler pre-filter template inputs and defer their loading if not

        		1 Gabor Kovacs [X] (Inactive) Done
         
        		DM-23103

        Update functor unittests to no longer rely on test_multilevel_parq.csv.gz

        		4 Chris Morrison [X] (Inactive) Done
         
        		DM-23196

        Add calibration storage to multiBand.py

        		6 Chris Morrison [X] (Inactive) Done
         
        		DM-23174

        Consolidate daf_butler test code

        		6 Krzysztof Findeisen Done
         
        		DM-23436

        apdb creation instructions outdated

        		1 John Swinbank Done
         
        		DM-23249

        New decam ingest tests need skipif for testdata_decam

        		0.5 John Parejko Done
         
        		DM-21302

        Produce design sketch for ip_diffim updates for Gen3

        		10 Gabor Kovacs [X] (Inactive) Done

          Activity

          Hide
          Permalink
          swinbank John Swinbank added a comment -

          Major progress was made towards Gen3 deployment on this epic, as well as substantial SDM standardization work. These activities will be completed in S20B on epic DM-23431.

          Show
          swinbank John Swinbank added a comment - Major progress was made towards Gen3 deployment on this epic, as well as substantial SDM standardization work. These activities will be completed in S20B on epic DM-23431 .

            People

            Assignee:
            swinbank John Swinbank
            Reporter:
            swinbank John Swinbank
            Watchers:
            John Swinbank
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.