Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16680

DRP QA, including fakes and drilldown tools, in S19

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
    • Epic Name:
      s19-drp-qa
    • Story Points:
      190
    • WBS:
      02C.04.07
    • Team:
      Data Release Production
    • Cycle:
      Spring 2019

      Attachments

        Container Issues

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-18150

        Make depth plots using fake sources

        2 Sophie Reed To Do
        DM-18153

        Make magnitude plots for fake based QA

        2 Sophie Reed To Do
        DM-18155

        Make shape plots using fake sources

        2 Sophie Reed To Do
        DM-17421

        Define monthly ImSim DC2 reprocessing dataset subset

        4 Lauren MacArthur To Do
        DM-19503

        Use DC2 Run2.1i to show how jointcal improves astrom vs ref cat flux cutoff

        Yusra AlSayyad To Do
        DM-19457

        Update pipe_analysis scripts to make use of PhotoCalib’s calibrateCatalog()

        2 Lauren MacArthur To Do
        DM-19477

        Double-check stabilized calibration conjecture of DM-19328

        Lauren MacArthur To Do
        DM-20051

        Make plots showing position and magnitude dependence of coordinate offsets for fakes QA plots.

        4 Sophie Reed To Do
        DM-16717

        processCcd HSC visit=36234 ccd=24 failed with w_2018_46 but passed with w_2018_47

        Unassigned To Do
        DM-16595

        Add "sky objects" qa plots to pipe_analysis

        5 Lauren MacArthur To Do
        DM-14556

        Investigate the need for a P2 -> P2' calibration for the HSC Principle Color analysis

        5 Lauren MacArthur To Do
        DM-14935

        Thoroughly assess of the effects of turning on "junk suppression" at the visit level

        Unassigned To Do
        DM-14590

        Refine HSC Principle Color coefficient calibration based on latest PDR1 processing

        6 Lauren MacArthur To Do
        DM-15301

        Invalid imports in one or more notebooks

        Tim Morton To Do
        DM-15101

        Update auto-generating QA notebooks to new code

        Tim Morton To Do
        DM-14559

        Make pipe_analysis compliant with LSST coding standards

        Lauren MacArthur To Do
        DM-14195

        Add "noFit" star + galaxy color-color plots that include density information

        2 Lauren MacArthur To Do
        DM-14196

        Explore the Principle Color fit sensitivity to magnitude limits

        4 Lauren MacArthur To Do
        DM-13058

        Inconsistent aperture corrections in W44 reprocessing of HSC RC1

        Unassigned To Do
        DM-13057

        Astrometric offset in W44 HSC RC1 reprocessing

        Unassigned To Do
        DM-13056

        Photometric offset in W44 HSC RC processing

        Unassigned To Do
        DM-12118

        Make mosaics of PSFs available for QA drill down

        Unassigned To Do
        DM-11285

        Investigate astrometric regression

        Unassigned To Do
        DM-11173

        Check log-based provenance of weekly RC processing inputs

        1 Lauren MacArthur To Do
        DM-11175

        Ensure Task metadata is written on failure and is correctly reset for each "run" invocation

        6 Unassigned To Do
        DM-11174

        Improve usage of CmdLineTask metadata

        6 Unassigned To Do
        DM-10573

        Include photometric depth analysis in science validation

        Unassigned To Do
        DM-8532

        Investigate misclassification of objects as galaxies vs HSC

        10 Lauren MacArthur To Do
        DM-19189

        Update flux limit for computing statistics to be based on S/N

        4 Lauren MacArthur In Progress
         
        DM-18745

        VisitAnalysis "distance" from refCat plots don't appear to use jointcal

        4 Lauren MacArthur Done
         
        DM-18638

        Check for at least 2 visits in AMx metric calculation.

        1 Yusra AlSayyad Done
         
        DM-18353

        Add pre-computed values to parquet tables output by pipe_analysis scripts

        6 Lauren MacArthur Done
         
        DM-18546

        Enable fastparquet as a read option for ParquetTable

        8 Tim Morton Done
         
        DM-18532

        Investigate cause of increase in Principal Color scatter in tract 9697

        4 Lauren MacArthur Done
         
        DM-18573

        Fix bug for running on DC2 data introduced by DM-13202

        1 Lauren MacArthur Done
         
        DM-18387

        Write a task to make a visit->coadd match table

        3 Tim Morton Done
         
        DM-18630

        Investigate jointcal astrometry models with Run2.1i data

        8 Yusra AlSayyad Done
         
        DM-18556

        Adapt visit and coadd qa analysis scripts to run on DESC DC2 outputs

        8 Lauren MacArthur Done
         
        DM-17830

        Investigate color-dependent offsets from ref cat in jointcal vs. meas_mosaic

        12 Yusra AlSayyad Done
         
        DM-18068

        Write pipe_analysis parquet tables as butler datasets

        2 Tim Morton Done
         
        DM-17429

        PSFs on coadds are narrower than in model

        1 Yusra AlSayyad Done
         
        DM-18295

        Investigate performance tradeoffs increasing warping to lanczos5

        5 Yusra AlSayyad Done
         
        DM-19793

        Profile New Scarlet Call Stack

        2 Nate Lust Done
         
        DM-19794

        Characterize where deblending time is being spent in new Scarlet

        6 Lauren MacArthur Done
         
        DM-19796

        Run and Analyze New Scarlet on Coadds with Fakes

        12 Sophie Reed Done
         
        DM-19759

        Count Exception rates from New Scarlet

        6 Yusra AlSayyad Done
         
        DM-19641

        Use jointcal instead of meas_mosaic in obs_subaru HSC coaddition

        1 Yusra AlSayyad Done
         
        DM-19815

        Compare Scarlet and SDSS deblender CModel

        6 Dan Taranu Done
         
        DM-19699

        Generate Coadds of 3 sizes and 2 depths for testing New Scarlet

        3 Yusra AlSayyad Done
         
        DM-19828

        Investigate oddness in error propagation with meas_mosaic's photoCalib

        3 Lauren MacArthur Done
         
        DM-19635

        Participate in Operations Rehearsal #1

        6 Lauren MacArthur Done
         
        DM-19328

        Investigate cause of small differences in Uber calibrations from w_2019_[06/10/14]

        3 Lauren MacArthur Done
         
        DM-19963

        Prepare a statement of work for the Quansight QA dashboard development

        8 Tim Morton Done
         
        DM-16785

        Investigate configurations for fitting DC2 u-band PSFs

        8 Lauren MacArthur Done
         
        DM-16414

        Confirm fix of DM-16392 after next RC2 processing

        2 Lauren MacArthur Done
         
        DM-16596

        Quality assessment of coadds created using jointcal calibrations

        16 Lauren MacArthur Done
         
        DM-13921

        Make demo of astrometric repeatability calculations using qa_explorer

        2 Tim Morton Done
         
        DM-13793

        Make qa_explorer eups-installable

        1 Tim Morton Done
         
        DM-13202

        get visitAnalysis to work on jointcal's output

        10 Lauren MacArthur Done
         
        DM-11974

        Add calibUsed-only qa plots to CoaddAnalysis

        1 Lauren MacArthur Done
         
        DM-11312

        Devise plan for more sensitive metrics for weekly builds

        10 Lauren MacArthur Done

          Activity

            People

            • Assignee:
              yusra Yusra AlSayyad
              Reporter:
              yusra Yusra AlSayyad
              Watchers:
              Yusra AlSayyad
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel