Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24344

QA tooling and monitoring of the AP pipeline in S20B

    Details

    • Type: Epic
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Epic Name:
      s20b-ap-qa
    • Story Points:
      99.9
    • WBS:
      02C.03.08
    • Team:
      Alert Production
    • Cycle:
      Spring 2020

      Description

      To include:

      • Analysis in preparation for the algorithms workshop;
      • Debugging the DCR mitigation system to address issues discovered in preparation for the above;
      • Processing of “fakes” through the AP pipeline;
      • Regular pipeline reprocessing, and QA analysis;
      • Generation of calibration products using Rubin observatory tooling.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-23311

        Put new HiTS2014 templates into ap_verify datasets

        4 Meredith Rawls To Do
        DM-14601

        Enable coaddName='goodSeeing' for obs_decam

        Eric Bellm To Do
        DM-12960

        write slurm wrapper for ap_verify

        2 Eric Bellm To Do
        DM-12849

        Update cross-references from ap_verify to verify

        4 Krzysztof Findeisen To Do
        DM-12549

        ap_pipe must call AssociationTask in a reproducible order

        Unassigned To Do
        DM-15340

        Expand results of DMTN-037 using Decam data

        6 Ian Sullivan To Do
        DM-15351

        Add "real commands" examples to ap_pipe documentation

        2 Unassigned To Do
        DM-19284

        Add color terms to obs_decam

        4 Meredith Rawls To Do
        DM-18688

        Develop a metric for spatial non-uniformity of DIASources

        10 Meredith Rawls To Do
        DM-20749

        Examine results of image differencing with inserted fakes

        4 Unassigned To Do
        DM-20458

        Enlarge regions masked via defects on DECam ccds

        Unassigned To Do
        DM-23072

        Confirm appropriate pixel scale for DECam coadds

        6 Meredith Rawls To Do
        DM-23068

        Rethink BestSeeingWcsSelectImageTask

        4 Meredith Rawls To Do
        DM-24338

        Audit status of calibrations in obs_decam

        6 Meredith Rawls To Do
        DM-24253

        Generate stack produced calibration products for HiTS

        8 Meredith Rawls To Do
        DM-24431

        Incorporate distortion model into obs_decam defaults

        4 Unassigned To Do
        DM-24430

        Generate DECam distorted camera geometry from Jointcal

        4 John Parejko To Do
        DM-17260

        Update ap_pipe documentation based on DMTN-039, AAS poster, etc.

        4 Meredith Rawls To Do
        DM-24731

        Create a test suite for (Dcr)AssembleCoaddTask

        12 Ian Sullivan To Do
        DM-24863

        Make new HSC coadd templates with smaller skymaps

        4 Meredith Rawls To Do
        DM-15929

        Define flags for DIAObjects

        4 Eric Bellm In Progress
        DM-17526

        Investigate known quasars in HiTS

        4 Ian Sullivan In Progress
        DM-21306

        Evaluate DCR model performance on sources of extreme color

        8 Ian Sullivan In Progress
        DM-23914

        Create Gen 3 fake insertion script for use in AP

        12 Chris Morrison In Progress
        DM-24252

        Run ap_pipe on HSC non-G COSMOS medium dataset

        10 Meredith Rawls In Progress
        DM-25018

        Monthly May ap_pipe HiTS2015 rerun

        2 Meredith Rawls In Progress
         
        DM-23675

        Prepare and present talk on DCR at the Algorithms Workshop

        8 Ian Sullivan Done
         
        DM-23430

        Run ap_pipe on HSC G PDR2 COSMOS dataset with RC2 templates

        4 Meredith Rawls Done
         
        DM-20556

        collect false positive sprint visualizations

        12 Meredith Rawls Done
         
        DM-24259

        Create “stub“ Gen2 HSC dataset for CI testing

        6 Krzysztof Findeisen Done
         
        DM-24366

        Monthly April ap_pipe HiTS2015 reprocessing

        2 Meredith Rawls Done
         
        DM-24429

        Investigate change in fracDiaSourcesToSciSources in ap_verify CI

        1 John Swinbank Done
         
        DM-23674

        Evaluate performance of DCR and CompareWarp templates on crowded field simulations

        6 Ian Sullivan Done
         
        DM-23631

        Create simple python script to create and insert fakes for the HiTS2015 AP processing.

        8 Chris Morrison Done
         
        DM-23429

        Generate COSMOS template coadds from HSC G RC2 data

        4 Meredith Rawls Done
         
        DM-24251

        Generate template coadds for HSC RC2 non-G bands

        7 Meredith Rawls Done
         
        DM-22431

        Make medium-scale HSC G dataset for diffim testing

        4 Meredith Rawls Done
        DM-17538

        Generate stack-produced (rather than CP) calibration products for DECam

        6 Meredith Rawls In Review
         
        DM-20748

        Initial fake insertion tests for AP image differencing

        8 Scott Daniel Won't Fix
         
        DM-23783

        Analyze and write up results of false positive detections in crowded field simulations

        4 Ian Sullivan Invalid

          Activity

            People

            • Assignee:
              swinbank John Swinbank
              Reporter:
              swinbank John Swinbank
              Watchers:
              John Swinbank
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel