Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30504

AP Algorithm development and data analysis in S22A

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      s22a-ap-algorithms&analysis
    • Story Points:
      60
    • WBS:
      02C.03.04
    • Team:
      Alert Production
    • Cycle:
      Spring 2022

      Description

      Regular analysis of processing of precursor data through AP pipelines, including identifying issues, tracking them down, and resolving them. Includes testing algorithmic changes on large datsets as well as developing and testing timeseries features.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-25989

        sqlite3 encounters database locked when APDB is large

        8 Unassigned To Do
        DM-30097

        Investigate spurious noise sources in HSC ap_pipe run

        2 Meredith Rawls To Do
        DM-28628

        Actually adopt new calibs in ap_verify HiTS datasets

        2 Meredith Rawls To Do
        DM-25108

        Execute AP pipeline on New Horizons test dataset

        10 Ian Sullivan To Do
        DM-25107

        Make templates from New Horizons AP test dataset

        6 Ian Sullivan To Do
        DM-25106

        Single frame processing of New Horizons HSC data for AP testing

        5 Ian Sullivan To Do
        DM-25051

        Implement proper variance plane calculation in the decorrelation afterburner

        4 Gabor Kovacs [X] (Inactive) To Do
        DM-32833

        Update dipole measurement for decorrelated images

        6 Unassigned To Do
        DM-32963

        Investigate increase in HiTS Characterize runtime due to config changes in obs_decam

        4 Meredith Rawls To Do
        DM-32962

        Investigate increase in HiTS DIASource counts due to config changes in obs_decam

        6 Meredith Rawls To Do
        DM-32890

        Investigating empty spatial regions in Saha Bulge processing

        4 Unassigned To Do
        DM-32889

        Propagate injected fakes mask plane into diffim

        6 Unassigned To Do
        DM-32770

        Process the DECAT DDF dataset

        6 Meredith Rawls To Do
        DM-32769

        Implement streak detection and masking in AP

        6 Meredith Rawls To Do
        DM-32988

        Update all ApPipe pipelines to use multi-tract difference imaging

        4 Meredith Rawls To Do
        DM-32800

        Test image differencing quality under different seeing conditions

        6 Ian Sullivan To Do
        DM-30462

        Properly scale the flux normalization of the ZOGY score image

        4 Gabor Kovacs [X] (Inactive) To Do
        DM-30461

        Raise error if doScaleDiffimVariance is set for a diffim score image

        1 Gabor Kovacs [X] (Inactive) To Do
        DM-29421

        Write analysis_ap package

        6 Meredith Rawls To Do
        DM-32535

        Change DCR interpolation order to 1

        2 Ian Sullivan To Do
        DM-32888

        Investigate negative totFlux values

        6 Unassigned To Do
        DM-28957

        Provide estimate of range of diaSources expected for APDB test

        2 Eric Bellm To Do
        DM-32147

        Investigate "noise" DIASources

        4 Kenneth Herner To Do
        DM-30991

        Investigate odd per-visit DIA Source plots in DC2

        2 Meredith Rawls To Do
        DM-22762

        Refactor AL subtraction preparatory code steps in ImageDifferenceTask into separate methods to improve code structure

        Unassigned To Do
        DM-22432

        Workaround to keep ScaleZeroPointTask while having calibrated templates

        Unassigned To Do
        DM-22825

        DCR coadds missing some artifact rejection

        4 Ian Sullivan To Do
        DM-24338

        Audit status of calibrations in obs_decam

        4 Meredith Rawls To Do
        DM-24431

        Incorporate distortion model into obs_decam

        4 John Parejko To Do
        DM-24430

        Generate DECam distorted camera geometry from Jointcal

        4 John Parejko To Do
        DM-23072

        Confirm appropriate pixel scale for DECam coadds

        6 Meredith Rawls To Do
        DM-24863

        Make new HSC coadd templates with smaller skymaps

        4 Meredith Rawls To Do
        DM-24726

        obs_decam does not test inter-chip crosstalk due to non-CT detectors in testdata_decam

        Unassigned To Do
        DM-23857

        Add support for spatially varying correction to the decorrelation afterburner

        10 Gabor Kovacs [X] (Inactive) To Do
        DM-23854

        Add spatially varying PSF solution to fixed decorrelation afterburner correction

        5 Gabor Kovacs [X] (Inactive) To Do
        DM-15351

        Add "real commands" examples to ap_pipe documentation

        2 Unassigned To Do
        DM-15340

        Expand results of DMTN-037 using Decam data

        6 Ian Sullivan To Do
        DM-21017

        Consider changing the automated algorithmic path in ip_diffim to disable automated deconvolution

        Unassigned To Do
        DM-21217

        Add option to select image to convolve based on seeing

        4 Ian Sullivan To Do
        DM-18688

        Develop a metric for spatial non-uniformity of DIASources

        10 Meredith Rawls To Do
        DM-22038

        Make CI-scale HSC dataset for diffim testing

        6 Meredith Rawls To Do
        DM-22273

        Create mini-refcat for ap_verify HiTS datasets from Gaia DR2

        2 Unassigned To Do
        DM-20458

        Enlarge regions masked via defects on DECam ccds

        Unassigned To Do
        DM-7684

        Clean up ip_diffim examples and tests

        6 Gabor Kovacs [X] (Inactive) To Do
        DM-8607

        Confusing warning running dipoleMeasTask.py example in ip_diffim

        2 Gabor Kovacs [X] (Inactive) To Do
        DM-15929

        Define flags for DIAObjects

        4 Eric Bellm To Do
        DM-17923

        Inconsistent source detection workflow with difference imaging

        Unassigned To Do
        DM-17018

        deprecate and disable ScaleZeroPointTask

        4 Unassigned To Do
        DM-31811

        Add Detection SNR to DIASource catalogs

        6 John Parejko In Progress
        DM-31884

        Test the performance of difference imaging

        6 Kenneth Herner In Progress
        DM-33001

        Design refactoring of ImageDifferenceTask

        8 Ian Sullivan In Progress
        DM-31388

        Investigate low fake injection completeness in HSC COSMOS

        6 Meredith Rawls In Progress
        DM-23853

        Create test cases for the decorrelation afterburner and image differencing

        8 Gabor Kovacs [X] (Inactive) In Progress
        DM-17526

        Investigate known quasars in HiTS

        4 Ian Sullivan In Progress
        DM-21306

        Evaluate DCR model performance on sources of extreme color

        8 Ian Sullivan In Progress
         
        DM-32807

        Set up basic data processing on the IDF

        6 Nima Sedaghat Done
         
        DM-30495

        Troubleshoot DECam ISR failures

        4 Meredith Rawls Done
         
        DM-32373

        Run Gen 3 single frame measurement on on validation_data_cfht

        8 John Parejko Done
         
        DM-32245

        Reprocess HiTS AP with fakes and an APDB

        8 Meredith Rawls Done
         
        DM-32585

        Run Gen 3 single frame measurement on on validation_data_decam

        4 John Parejko Won't Fix
         
        DM-23068

        Rethink BestSeeingWcsSelectImageTask

        4 Meredith Rawls Won't Fix
         
        DM-12849

        Update cross-references from ap_verify to verify

        4 Krzysztof Findeisen Won't Fix
         
        DM-21847

        Deep coadd images contain a grid pattern in the variance plane

        Meredith Rawls Won't Fix
         
        DM-19284

        Add color terms to obs_decam

        4 Meredith Rawls Won't Fix
         
        DM-29419

        Debug preconvolution option in image differencing

        6 Unassigned Invalid

          Activity

          There are no comments yet on this issue.

            People

            Assignee:
            sullivan Ian Sullivan
            Reporter:
            sullivan Ian Sullivan
            Watchers:
            Ian Sullivan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:

                CI Builds

                No builds found.