XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      s22b-drp-qa
    • Story Points:
      175.688
    • WBS:
      02C.04.07
    • Team:
      Data Release Production
    • Cycle:
      Spring 2022

      Description

      • Held a 10 day sprint to start generating the QA plots automatically during the Gen3 biweekly mini-DRPs. The new plotting Pipeline was run first for the w_2022_12 mini-DRP. This plotting pipeline is now run during every mini DRP and the plots are inspected via web browser at the biweekly DRP Metrics Meeting.
      • Plots that compute input vs. output quantities for simulated data sets
      • Per object E(B-V) column was added to the Object Table. DM-33948
      • Fixed a problem with ConfigurableActionStructField DM-33977
      • Set up the source_injection repository [DM-34170, DM-34178,

      -Supported the commissioning of PIFF by adding tract-level PSF ellipticity plots for RC2/DC2 metrics meetings [DM-34309, DM-34406]

      • Increased frequency of DRP Metrics Meeting reviews of the 3-tract mini-DRPs to every 2 weeks (previously every month)

      Augment and improve plots that get automatically produced during the DRPs:

      • Added a Task that measures sky objects fluxes (average and scatter) during the default DRP pipeline [DM-31860, DM-34489]
      • Added rho-statistics plot to analysis_drp DM-33123
      • Improved ellipticity plots [DM-34682, DM-34897, DM-34866, DM-34692]
      • Modify sky object plots/metrics to exclude those in NO_DATA regions DM-33805
      • Revise stats printed on scatter plots DM-34117

      -Began designing module and class structure for analysis_tools a plotting and metrics package

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        DM-34133

        Add ScatterPlot test to analysis_drp

        3 Dan Taranu Done
         
        DM-34124

        Add separate histogram label argument into histPlot

        2 Lee Kelvin Done
         
        DM-33123

        Add Rho statistics to analysis_drp

        12 Arun Kannawadi Done
         
        DM-34692

        Fix band list for CoaddPlotFlag & Sn Selectors in coaddQAEllip pipeline

        2 Lauren MacArthur Done
         
        DM-34682

        Fix y-axis label for visit level E2 difference plots

        1 Lauren MacArthur Done
         
        DM-34630

        Add quantities useful for QA to ccdVisitTable

        3 Lauren MacArthur Done
         
        DM-34583

        Fix faro sky object metric lookup name

        2 Lee Kelvin Done
         
        DM-33805

        Modify sky object plots/metrics to exclude those in NO_DATA regions

        3 Lee Kelvin Done
         
        DM-34355

        Improve analysis_drp scatterPlot unit test

        5 Dan Taranu Done
         
        DM-34349

        Build pipelines before testing analysis drp

        0.5 Nate Lust Done
         
        DM-34326

        Make Configurable actions add their targets to import list

        2 Nate Lust Done
         
        DM-34309

        Make tract-level PSF ellipticity plots for RC2/DC2 metrics meetings

        3 Arun Kannawadi Done
         
        DM-34406

        Make axis limits in scatter plots robust to outliers

        2 Arun Kannawadi Done
         
        DM-34402

        Allow specify the type of size and ellipticities in calcFunctors

        4 Arun Kannawadi Done
         
        DM-34117

        Revise stats printed on scatter plots

        12 Sophie Reed Done
         
        DM-34114

        Reintroduce the else block in scatterPlot.py

        0.5 Arun Kannawadi Done
         
        DM-34082

        Add checks to avoid failures on empty arrays

        2 Arun Kannawadi Done
         
        DM-34080

        Fix task breakage in DM-33965

        0.5 Arun Kannawadi Done
         
        DM-34052

        Rename FractionalResidualColumns to FractionalDifferenceColumns

        1 Arun Kannawadi Done
         
        DM-33993

        Apply Galactic Extinction in ColorColorFitPlotTask

        6 Yusra AlSayyad Done
         
        DM-33992

        Create plotting pipelines in drp_pipe to run during regular DC2/ RC2 reprocessing

        6 Nate Lust Done
         
        DM-33977

        Nesting ConfigurableActionStructField config produces error

        1.5 Nate Lust Done
         
        DM-33966

        Add PSF size residual plots in analysis_drp

        2 Arun Kannawadi Done
         
        DM-33965

        Add PSF ellipticity whisker plots in analysis_drp

        5 Arun Kannawadi Done
         
        DM-33963

        Add PipelineTask to aggregate memory/time usage from task metadata

        6 Jim Bosch Done
         
        DM-33961

        Generalize histogram plotting task to n-panels

        12 Lee Kelvin Done
         
        DM-33959

        Calibrate Source Tables with Global Calibrations (jointcal/FGCM)

        4 Yusra AlSayyad Done
         
        DM-33957

        Add red galaxy color error plots to analysis_drp

        3 Eli Rykoff Done
         
        DM-33956

        Make 2d histogram option for scatter plots

        12 Sophie Reed Done
         
        DM-33949

        Add objectTable_tract matched diff plots to analysis_drp

        12 Dan Taranu Done
         
        DM-33948

        Add Per-object galactic extinction to Object Table

        3 Yusra AlSayyad Done
         
        DM-34897

        Update connections class in QuiverPlotTask

        2 Lauren MacArthur Done
         
        DM-34866

        Fix column being used for plot_CircAp12_sub_PSF_meas_sky_stars

        1 Lauren MacArthur Done
         
        DM-33457

        RC2 reprocessing with w_2022_04 (gen2)

        5 Lauren MacArthur Done
         
        DM-31751

        Develop analysis_drp plots further

        10 Sophie Reed Done

          Activity

          There are no comments yet on this issue.

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            yusra Yusra AlSayyad
            Watchers:
            Yusra AlSayyad
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.