Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26809

AP data analysis and QA in F20B

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      f20b-ap-analysis
    • Story Points:
      79.3
    • WBS:
      02C.03.04
    • Team:
      Alert Production
    • Cycle:
      Fall 2020

      Description

      Regular analysis of processing of DECam and HSC data through AP pipelines, including identifying issues, tracking them down, and resolving them. Where appropriate, integrating analysis of new datasets, and ultimately working with the Data Facility to automate processing. Further characterize and report on the performance of AP pipelines in crowded fields.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-25696

        Execute AP pipeline on DECam bulge test dataset

        10 Ian Sullivan To Do
        DM-25108

        Execute AP pipeline on New Horizons test dataset

        10 Ian Sullivan To Do
        DM-25107

        Make templates from New Horizons AP test dataset

        6 Ian Sullivan To Do
        DM-25106

        Single frame processing of New Horizons HSC data for AP testing

        5 Ian Sullivan To Do
        DM-24431

        Incorporate distortion model into obs_decam defaults

        4 Unassigned To Do
        DM-24430

        Generate DECam distorted camera geometry from Jointcal

        4 John Parejko To Do
        DM-24338

        Audit status of calibrations in obs_decam

        6 Meredith Rawls To Do
        DM-22825

        DCR coadds missing some artifact rejection

        4 Ian Sullivan To Do
        DM-22432

        Workaround to keep ScaleZeroPointTask while having calibrated templates

        Unassigned To Do
        DM-22273

        Create mini-refcat for ap_verify HiTS datasets from Gaia DR2

        2 Unassigned To Do
        DM-22038

        Make CI-scale HSC dataset for diffim testing

        6 Meredith Rawls To Do
        DM-21847

        Deep coadd images contain a grid pattern in the variance plane

        Meredith Rawls To Do
        DM-24913

        obs_decam README is confusing

        4 Meredith Rawls To Do
        DM-24726

        obs_decam does not test inter-chip crosstalk due to non-CT detectors in testdata_decam

        Unassigned To Do
        DM-24863

        Make new HSC coadd templates with smaller skymaps

        4 Meredith Rawls To Do
        DM-23072

        Confirm appropriate pixel scale for DECam coadds

        6 Meredith Rawls To Do
        DM-23068

        Rethink BestSeeingWcsSelectImageTask

        4 Meredith Rawls To Do
        DM-27370

        Monthly reprocessing of HiTS for December 2020

        6 Meredith Rawls To Do
        DM-27032

        Create deblended source metric

        2 Krzysztof Findeisen To Do
        DM-27031

        Use primary flag in source count metrics

        2 Krzysztof Findeisen To Do
        DM-26413

        Investigate modest DIA Source count increase between w_15 and w_20

        2 Meredith Rawls To Do
        DM-25991

        Update ap_pipe plotting tools

        8 Meredith Rawls To Do
        DM-25989

        sqlite3 encounters database locked when APDB is large

        8 Unassigned To Do
        DM-20458

        Enlarge regions masked via defects on DECam ccds

        Unassigned To Do
        DM-19284

        Add color terms to obs_decam

        4 Meredith Rawls To Do
        DM-18688

        Develop a metric for spatial non-uniformity of DIASources

        10 Meredith Rawls To Do
        DM-17018

        deprecate and disable ScaleZeroPointTask

        4 Unassigned To Do
        DM-17260

        Update ap_pipe documentation based on DMTN-039, AAS poster, etc.

        4 Meredith Rawls To Do
        DM-12960

        write slurm wrapper for ap_verify

        2 Eric Bellm To Do
        DM-12549

        ap_pipe must call AssociationTask in a reproducible order

        Unassigned To Do
        DM-12849

        Update cross-references from ap_verify to verify

        4 Krzysztof Findeisen To Do
        DM-14601

        Enable coaddName='goodSeeing' for obs_decam

        Eric Bellm To Do
        DM-15351

        Add "real commands" examples to ap_pipe documentation

        2 Unassigned To Do
        DM-15340

        Expand results of DMTN-037 using Decam data

        6 Ian Sullivan To Do
        DM-27659

        Adopt new calibs and templates for ap_verify HiTS datasets

        2 Meredith Rawls To Do
        DM-21306

        Evaluate DCR model performance on sources of extreme color

        8 Ian Sullivan In Progress
        DM-25988

        Examine HSC COSMOS ap_pipe failures to retrieve template

        2 Meredith Rawls In Progress
        DM-15929

        Define flags for DIAObjects

        4 Eric Bellm In Progress
        DM-17526

        Investigate known quasars in HiTS

        4 Ian Sullivan In Progress
        DM-26971

        Generate Gen 3 stack produced calibration products for HiTS

        8 Meredith Rawls In Progress
        DM-25695

        Make templates from DECam bulge AP test dataset

        6 Ian Sullivan In Review
         
        DM-25694

        Single frame processing of DECam bulge data for AP testing

        5 Ian Sullivan Done
         
        DM-26695

        Evaluate sensitivity of current AP astrometry to WCS inaccuracies

        12 Chris Morrison Done
         
        DM-26783

        DiaForcedSource on associated DiaObject off frame

        2 Chris Morrison Done
         
        DM-26586

        Investigate LengthError when running ProcessCcd on Decam galactic bulge images

        5 Ian Sullivan Done
         
        DM-26584

        Investigate IndexError when running ProcessCcd on Decam galactic bulge images

        5 Ian Sullivan Done
         
        DM-25990

        Reprocess HSC COSMOS medium dataset with ap_pipe

        8 Meredith Rawls Done
         
        DM-24253

        Generate stack produced calibration products for HiTS

        8 Meredith Rawls Done
         
        DM-25124

        Compare AP Pipe processing with CP and Stack Calib Products

        8 Meredith Rawls Done

          Activity

          There are no comments yet on this issue.

            People

            • Assignee:
              sullivan Ian Sullivan
              Reporter:
              swinbank John Swinbank
              Watchers:
              John Swinbank
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel