Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22633

AP pipeline infrastructure in S20A

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Epic Name:
      s20a-ap-infrastructure
    • Story Points:
      160
    • WBS:
      02C.03.05
    • Team:
      Alert Production
    • Cycle:
      Spring 2020

      Description

      This epic includes AP work in S20A dedicated to:

      • Science Data Model standardization;
      • Upgrades to the Exposure class and related code;
      • Support for “Generation 3” middleware.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-21862

        Extend Gen3 butler support for obs_decam

        8 John Parejko To Do
        DM-21939

        Create Gen 3 AP Pipeline

        1 Meredith Rawls To Do
        DM-20970

        timeMethod gives platform-dependent results

        3 Unassigned To Do
        DM-22953

        Add back compatibility functionality of kernel source selection and post-subtraction only mode in ImageDifferenceTask gen3 mode

        6 Unassigned To Do
        DM-22952

        Add support of dcr coadds to ImageDifferenceTask in gen3 mode

        4 Ian Sullivan To Do
        DM-21267

        Enforce consistency between the expected filter columns in ap_association and dax_ppdb.

        8 Chris Morrison To Do
        DM-22655

        Genericize gen2to3.py to be useable with any gen2 repo

        4 John Parejko In Progress
        DM-21874

        Create PipelineTask version of backward compatible ImageDifferenceTask

        0 Gabor Kovacs In Progress
        DM-21937

        Create new error-handling protocol for MetricTask

        Unassigned In Progress
        DM-21915

        Support Gen 3 ingestion of ap_verify datasets

        6 Krzysztof Findeisen In Progress
        DM-22038

        Make CI-scale HSC dataset for diffim testing

        6 Meredith Rawls In Progress
        DM-21016

        Handle DECam instrument signature data in gen3

        8 John Parejko In Progress
        DM-20994

        Write how to make gen3 obs package guide

        4 John Parejko In Progress
        DM-20144

        Research off-the-shelf persistence frameworks

        10 Krzysztof Findeisen In Progress
        DM-22431

        Make medium-scale HSC dataset for diffim testing

        4 Meredith Rawls In Progress
        DM-19470

        Create jointcal PipelineTask

        8 John Parejko In Progress
         
        DM-23436

        apdb creation instructions outdated

        1 John Swinbank Done
         
        DM-22648

        Add DcrModel to Gen3 butler

        4 Ian Sullivan Done
         
        DM-21886

        Create PipelineTask driver for ap_pipe tasks that interact with the APDB

        8 Chris Morrison Done
         
        DM-21885

        Convert concrete MetricTasks to PipelineTasks

        0 Krzysztof Findeisen Done
         
        DM-21917

        Convert DCR templates to PipelineTasks

        8 Ian Sullivan Done
         
        DM-21912

        Implement PpdbMetricTask.runQuantum

        1 Krzysztof Findeisen Done
         
        DM-21911

        Retrofit Gen 3 functionality onto MetricTask

        4 Krzysztof Findeisen Done
         
        DM-23140

        Announce ip_diffim Gen3 transition plan on CLO

        1 Gabor Kovacs Done
         
        DM-23139

        Check whether the gen3 butler pre-filter template inputs and defer their loading if not

        1 Gabor Kovacs Done
         
        DM-23249

        New decam ingest tests need skipif for testdata_decam

        0.5 John Parejko Done
         
        DM-22505

        Create run method in ImageDifferenceTask and move all functionality from runDataRef except butler usage

        6 Gabor Kovacs Done
         
        DM-22482

        Write up design sketch on Gen3 calibration product handling

        4 John Parejko Done
         
        DM-22478

        Lightly restructure ap_association tasks and create new DiaObject/DiaSource pre-loading task.

        6 Chris Morrison Done
         
        DM-23008

        Add DCR model subfilters to Gen3 registry

        5 Ian Sullivan Done
         
        DM-22708

        Fix decam gen3 ingest

        8 John Parejko Done
         
        DM-21302

        Produce design sketch for ip_diffim updates for Gen3

        10 Gabor Kovacs Done
        DM-22541

        Add gen3 support classes to ImageDifferenceTask

        6 Gabor Kovacs Reviewed

          Activity

            People

            • Assignee:
              swinbank John Swinbank
              Reporter:
              swinbank John Swinbank
              Watchers:
              John Swinbank
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel