Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25272

QA including fakes, sims, and drill down tools in F20A

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      f20a-drp-qa
    • Story Points:
      97.4
    • WBS:
      02C.04.07
    • Team:
      Data Release Production
    • Cycle:
      Fall 2020

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
      DM-23250

      Run the visit & coadd pipe_analysis scripts on processed DC2 Run2.2i data

      Lauren MacArthur To Do
      DM-23550

      Adapt visitAnalysis.py to work with forced src (ccd) catalogs

      Lauren MacArthur To Do
      DM-22410

      Evaluate qa_explorer/matchVisits and move necessary functionality to pipe_tasks

      1 Yusra AlSayyad To Do
      DM-21315

      Add some coaddition metrics

      3 Yusra AlSayyad To Do
      DM-24795

      Decide what to do with the stats returned from plotAll in pipe_analysis/analysis.py.

      Unassigned To Do
      DM-14935

      Thoroughly assess of the effects of turning on "junk suppression" at the visit level

      Unassigned To Do
      DM-14559

      Make pipe_analysis compliant with LSST coding standards

      Lauren MacArthur To Do
      DM-14556

      Investigate the need for a P2 -> P2' calibration for the HSC Principle Color analysis

      5 Lauren MacArthur To Do
      DM-14590

      Refine HSC Principle Color coefficient calibration based on latest PDR1 processing

      6 Lauren MacArthur To Do
      DM-14196

      Explore the Principle Color fit sensitivity to magnitude limits

      4 Lauren MacArthur To Do
      DM-14195

      Add "noFit" star + galaxy color-color plots that include density information

      2 Lauren MacArthur To Do
      DM-15101

      Update auto-generating QA notebooks to new code

      Tim Morton To Do
      DM-15301

      Invalid imports in one or more notebooks

      Tim Morton To Do
      DM-16479

      Figure out why matching is failing after fake sources have been inserted

      4 Sophie Reed To Do
      DM-16278

      Add datatype to obs_base for calexps with fakes inserted.

      2 Sophie Reed To Do
      DM-16254

      Change read/write of fake source catalog to use new pipeline task

      2 Sophie Reed To Do
      DM-13058

      Inconsistent aperture corrections in W44 reprocessing of HSC RC1

      Unassigned To Do
      DM-13057

      Astrometric offset in W44 HSC RC1 reprocessing

      Unassigned To Do
      DM-13056

      Photometric offset in W44 HSC RC processing

      Unassigned To Do
      DM-12118

      Make mosaics of PSFs available for QA drill down

      Unassigned To Do
      DM-19457

      Update pipe_analysis scripts to make use of PhotoCalib’s calibrateCatalog()

      2 Lauren MacArthur To Do
      DM-19503

      Use DC2 Run2.1i to show how jointcal improves astrom vs ref cat flux cutoff

      Yusra AlSayyad To Do
      DM-19477

      Double-check stabilized calibration conjecture of DM-19328

      Lauren MacArthur To Do
      DM-11175

      Ensure Task metadata is written on failure and is correctly reset for each "run" invocation

      6 Unassigned To Do
      DM-11174

      Improve usage of CmdLineTask metadata

      6 Unassigned To Do
      DM-11285

      Investigate astrometric regression

      Unassigned To Do
      DM-10573

      Include photometric depth analysis in science validation

      Unassigned To Do
      DM-8532

      Investigate misclassification of objects as galaxies vs HSC

      10 Lauren MacArthur To Do
      DM-22266

      Adapt coaddAnalysis to run on deepCoadd_obj parquet table in Gen2

      Lauren MacArthur In Progress
      DM-21978

      Add ability to apply an external photometric calibration to afw.cameraGeom.utils

      2 Lauren MacArthur In Progress
      DM-21397

      Various updates to pipe_analysis inspired by focused sprint work

      10 Lauren MacArthur In Progress
      DM-21092

      Make coadd versions of the other fakes QA plots

      4 Sophie Reed In Progress
       
      DM-26607

      Make pipe_analysis flake8 compliant and enable Travis and branch protections

      5 Lauren MacArthur Done
       
      DM-23829

      UnboundLocalError: local variable 'axes2' referenced before assignment

      4 Lauren MacArthur Done
       
      DM-21319

      Add first metric to fakesAnalysis

      4 Sophie Reed Done
       
      DM-25747

      Update fakes code to add images directly

      4 Sophie Reed Done
       
      DM-25285

      Refactor the fakes insertion code to make it easier to keep the configs up to date with the rest of the stack.

      4 Sophie Reed Done
       
      DM-26418

      Fix bug in insertFakes found during fakes RC processing.

      3 Sophie Reed Done
       
      DM-25863

      Fix and update metric generation in colorAnalysis.py

      2 Lauren MacArthur Done
       
      DM-25662

      Add a column to the input fakes catalogue that specified if the source is to be added to the coadd or the calexp.

      4 Sophie Reed Done
       
      DM-26244

      A few hot-fixes for pipe_analysis scripts post DM-22255

      10 Lauren MacArthur Done
       
      DM-26240

      Participate in Operations Rehearsal #2

      10 Lauren MacArthur Done
       
      DM-26082

      Persist source-to-external reference matched catalogs in pipe_analysis to parquet

      4 Lauren MacArthur Done
       
      DM-25709

      Investigate presence of extended/LSB "junk" sources in HSC RC2

      7 Lauren MacArthur Done
       
      DM-25628

      Update insertFakes to improve useability

      4 Sophie Reed Done
       
      DM-25206

      Un-bitrot the star galaxy classifer.

      3 Sophie Reed Done
       
      DM-20051

      Make plots showing position and magnitude dependence of coordinate offsets for fakes QA plots.

      4 Sophie Reed Done
       
      DM-16717

      processCcd HSC visit=36234 ccd=24 failed with w_2018_46 but passed with w_2018_47

      Unassigned Won't Fix
       
      DM-11173

      Check log-based provenance of weekly RC processing inputs

      1 Lauren MacArthur Won't Fix

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            yusra Yusra AlSayyad
            Reporter:
            yusra Yusra AlSayyad
            Watchers:
            Yusra AlSayyad
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Summary Panel