Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10044

Produce QA plots

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      3
    • Epic Link:
    • Sprint:
      DRP S17-5, DRP S17-6
    • Team:
      Data Release Production

      Description

      Take the scripts provided by Lauren MacArthur and apply them to a reprocessing of the HSC RC dataset (either that generated by DM-10043 or some other recent job) to generate the "standard" series of QA plots.

        Attachments

        1. HSC-I.zip
          14.84 MB
        2. plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-psfMagHist.png
          plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-psfMagHist.png
          158 kB
        3. plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-gals.png
          plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-gals.png
          307 kB
        4. plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-stars.png
          plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-stars.png
          294 kB
        5. plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-psfMagHist.png
          plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-psfMagHist.png
          143 kB
        6. plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-gals.png
          plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-gals.png
          308 kB
        7. plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-stars.png
          plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-stars.png
          296 kB
        8. plot-t8766-HSC-I-compareUnforced_modelfit_CModel-psfMagHist.png
          plot-t8766-HSC-I-compareUnforced_modelfit_CModel-psfMagHist.png
          125 kB
        9. plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-gals.png
          plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-gals.png
          283 kB
        10. plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-stars.png
          plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-stars.png
          277 kB
        11. plot-t8766-HSC-I-deconvMom-psfMagHist.png
          plot-t8766-HSC-I-deconvMom-psfMagHist.png
          169 kB
        12. plot-t8766-HSC-I-deconvMom-sky-gals.png
          plot-t8766-HSC-I-deconvMom-sky-gals.png
          283 kB
        13. plot-t8766-HSC-I-deconvMom-sky-stars.png
          plot-t8766-HSC-I-deconvMom-sky-stars.png
          279 kB
        14. plot-t8766-HSC-I-e1Resids_-psfMagHist.png
          plot-t8766-HSC-I-e1Resids_-psfMagHist.png
          210 kB
        15. plot-t8766-HSC-I-e1Resids_-sky-stars.png
          plot-t8766-HSC-I-e1Resids_-sky-stars.png
          318 kB
        16. plot-t8766-HSC-I-e1ResidsHsm_-psfMagHist.png
          plot-t8766-HSC-I-e1ResidsHsm_-psfMagHist.png
          209 kB
        17. plot-t8766-HSC-I-e1ResidsHsm_-sky-stars.png
          plot-t8766-HSC-I-e1ResidsHsm_-sky-stars.png
          316 kB
        18. plot-t8766-HSC-I-ellipResids-quiver.png
          plot-t8766-HSC-I-ellipResids-quiver.png
          484 kB
        19. plot-t8766-HSC-I-ellipResids-quiver.png
          plot-t8766-HSC-I-ellipResids-quiver.png
          481 kB
        20. plot-t8766-HSC-I-footNpix_calib_psfUsed-psfMagHist.png
          plot-t8766-HSC-I-footNpix_calib_psfUsed-psfMagHist.png
          166 kB
        21. plot-t8766-HSC-I-footNpix_calib_psfUsed-sky-stars.png
          plot-t8766-HSC-I-footNpix_calib_psfUsed-sky-stars.png
          300 kB
        22. plot-t8766-HSC-I-footNpix-hist.png
          plot-t8766-HSC-I-footNpix-hist.png
          28 kB
        23. plot-t8766-HSC-I-footNpix-psfMagHist.png
          plot-t8766-HSC-I-footNpix-psfMagHist.png
          181 kB
        24. plot-t8766-HSC-I-footNpix-sky-gals.png
          plot-t8766-HSC-I-footNpix-sky-gals.png
          304 kB
        25. plot-t8766-HSC-I-footNpix-sky-stars.png
          plot-t8766-HSC-I-footNpix-sky-stars.png
          275 kB
        26. plot-t8766-HSC-I-hsmTrace_-psfMagHist.png
          plot-t8766-HSC-I-hsmTrace_-psfMagHist.png
          178 kB
        27. plot-t8766-HSC-I-hsmTrace_-sky-stars.png
          plot-t8766-HSC-I-hsmTrace_-sky-stars.png
          314 kB
        28. plot-t8766-HSC-I-mag_base_GaussianFlux-psfMagHist.png
          plot-t8766-HSC-I-mag_base_GaussianFlux-psfMagHist.png
          150 kB
        29. plot-t8766-HSC-I-mag_base_GaussianFlux-sky-gals.png
          plot-t8766-HSC-I-mag_base_GaussianFlux-sky-gals.png
          300 kB
        30. plot-t8766-HSC-I-mag_base_GaussianFlux-sky-stars.png
          plot-t8766-HSC-I-mag_base_GaussianFlux-sky-stars.png
          310 kB
        31. plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-psfMagHist.png
          plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-psfMagHist.png
          154 kB
        32. plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-gals.png
          plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-gals.png
          296 kB
        33. plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-stars.png
          plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-stars.png
          310 kB
        34. plot-t8766-HSC-I-mag_modelfit_CModel-psfMagHist.png
          plot-t8766-HSC-I-mag_modelfit_CModel-psfMagHist.png
          113 kB
        35. plot-t8766-HSC-I-mag_modelfit_CModel-sky-gals.png
          plot-t8766-HSC-I-mag_modelfit_CModel-sky-gals.png
          289 kB
        36. plot-t8766-HSC-I-mag_modelfit_CModel-sky-stars.png
          plot-t8766-HSC-I-mag_modelfit_CModel-sky-stars.png
          289 kB
        37. plot-t8766-HSC-I-overlap_base_GaussianFlux-psfMagHist.png
          plot-t8766-HSC-I-overlap_base_GaussianFlux-psfMagHist.png
          143 kB
        38. plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-gals.png
          plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-gals.png
          146 kB
        39. plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-stars.png
          plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-stars.png
          115 kB
        40. plot-t8766-HSC-I-overlap_distance-psfMagHist.png
          plot-t8766-HSC-I-overlap_distance-psfMagHist.png
          129 kB
        41. plot-t8766-HSC-I-overlap_distance-sky-gals.png
          plot-t8766-HSC-I-overlap_distance-sky-gals.png
          91 kB
        42. plot-t8766-HSC-I-overlap_distance-sky-stars.png
          plot-t8766-HSC-I-overlap_distance-sky-stars.png
          94 kB
        43. plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-psfMagHist.png
          plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-psfMagHist.png
          145 kB
        44. plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-gals.png
          plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-gals.png
          146 kB
        45. plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-stars.png
          plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-stars.png
          114 kB
        46. plot-t8766-HSC-I-overlap_modelfit_CModel-psfMagHist.png
          plot-t8766-HSC-I-overlap_modelfit_CModel-psfMagHist.png
          154 kB
        47. plot-t8766-HSC-I-overlap_modelfit_CModel-sky-gals.png
          plot-t8766-HSC-I-overlap_modelfit_CModel-sky-gals.png
          147 kB
        48. plot-t8766-HSC-I-overlap_modelfit_CModel-sky-stars.png
          plot-t8766-HSC-I-overlap_modelfit_CModel-sky-stars.png
          114 kB
        49. plot-t8766-HSC-I-psfHsmTraceDiff_-psfMagHist.png
          plot-t8766-HSC-I-psfHsmTraceDiff_-psfMagHist.png
          198 kB
        50. plot-t8766-HSC-I-psfHsmTraceDiff_-sky-stars.png
          plot-t8766-HSC-I-psfHsmTraceDiff_-sky-stars.png
          307 kB
        51. plot-t8766-HSC-I-psfTraceDiff_-psfMagHist.png
          plot-t8766-HSC-I-psfTraceDiff_-psfMagHist.png
          199 kB
        52. plot-t8766-HSC-I-psfTraceDiff_-sky-stars.png
          plot-t8766-HSC-I-psfTraceDiff_-sky-stars.png
          308 kB
        53. plot-t8766-HSC-I-pStar-psfMagHist.png
          plot-t8766-HSC-I-pStar-psfMagHist.png
          128 kB
        54. plot-t8766-HSC-I-pStar-sky-stars.png
          plot-t8766-HSC-I-pStar-sky-stars.png
          223 kB
        55. plot-t8766-HSC-I-trace_-psfMagHist.png
          plot-t8766-HSC-I-trace_-psfMagHist.png
          179 kB
        56. plot-t8766-HSC-I-trace_-sky-stars.png
          plot-t8766-HSC-I-trace_-sky-stars.png
          316 kB

          Issue Links

            Activity

            No builds found.
            swinbank John Swinbank created issue -
            swinbank John Swinbank made changes -
            Field Original Value New Value
            Epic Link DM-8299 [ 27821 ]
            swinbank John Swinbank made changes -
            Link This issue blocks DM-10045 [ DM-10045 ]
            swinbank John Swinbank made changes -
            Sprint DRP S17-4 [ 363 ] DRP S17-5 [ 364 ]
            tmorton Tim Morton [X] (Inactive) made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            Here are the QA plots from tract 8766 of the RC-wide test pipeline run (from DM-10043). I ran this with -c doPlotMatches=False to avoid a as-yet-unsolved error.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Here are the QA plots from tract 8766 of the RC-wide test pipeline run (from DM-10043 ). I ran this with -c doPlotMatches=False to avoid a as-yet-unsolved error.
            tmorton Tim Morton [X] (Inactive) made changes -
            Attachment plot-t8766-HSC-I-overlap_modelfit_CModel-psfMagHist.png [ 29431 ]
            Attachment plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-stars.png [ 29432 ]
            Attachment plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-gals.png [ 29433 ]
            Attachment plot-t8766-HSC-I-e1Resids_-psfMagHist.png [ 29434 ]
            Attachment plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-psfMagHist.png [ 29435 ]
            Attachment plot-t8766-HSC-I-psfTraceDiff_-psfMagHist.png [ 29436 ]
            Attachment plot-t8766-HSC-I-mag_base_GaussianFlux-sky-gals.png [ 29437 ]
            Attachment plot-t8766-HSC-I-hsmTrace_-sky-stars.png [ 29438 ]
            Attachment plot-t8766-HSC-I-footNpix-psfMagHist.png [ 29439 ]
            Attachment plot-t8766-HSC-I-footNpix-hist.png [ 29440 ]
            Attachment plot-t8766-HSC-I-deconvMom-sky-gals.png [ 29441 ]
            Attachment plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-gals.png [ 29442 ]
            Attachment plot-t8766-HSC-I-trace_-sky-stars.png [ 29443 ]
            Attachment plot-t8766-HSC-I-pStar-psfMagHist.png [ 29444 ]
            Attachment plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-stars.png [ 29445 ]
            Attachment plot-t8766-HSC-I-mag_modelfit_CModel-psfMagHist.png [ 29446 ]
            Attachment plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-psfMagHist.png [ 29447 ]
            Attachment plot-t8766-HSC-I-mag_base_GaussianFlux-sky-stars.png [ 29448 ]
            Attachment plot-t8766-HSC-I-hsmTrace_-psfMagHist.png [ 29449 ]
            Attachment plot-t8766-HSC-I-footNpix-sky-gals.png [ 29450 ]
            Attachment plot-t8766-HSC-I-ellipResids-quiver.png [ 29451 ]
            Attachment plot-t8766-HSC-I-e1ResidsHsm_-sky-stars.png [ 29452 ]
            Attachment plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-stars.png [ 29453 ]
            Attachment plot-t8766-HSC-I-trace_-psfMagHist.png [ 29454 ]
            Attachment plot-t8766-HSC-I-pStar-sky-stars.png [ 29455 ]
            Attachment plot-t8766-HSC-I-psfHsmTraceDiff_-sky-stars.png [ 29456 ]
            Attachment plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-psfMagHist.png [ 29457 ]
            Attachment plot-t8766-HSC-I-overlap_distance-sky-stars.png [ 29458 ]
            Attachment plot-t8766-HSC-I-overlap_distance-psfMagHist.png [ 29459 ]
            Attachment plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-gals.png [ 29460 ]
            Attachment plot-t8766-HSC-I-mag_modelfit_CModel-sky-stars.png [ 29461 ]
            Attachment plot-t8766-HSC-I-mag_modelfit_CModel-sky-gals.png [ 29462 ]
            Attachment plot-t8766-HSC-I-footNpix_calib_psfUsed-psfMagHist.png [ 29463 ]
            Attachment plot-t8766-HSC-I-e1ResidsHsm_-psfMagHist.png [ 29464 ]
            Attachment plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-gals.png [ 29465 ]
            Attachment plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-gals.png [ 29466 ]
            Attachment plot-t8766-HSC-I-psfTraceDiff_-sky-stars.png [ 29467 ]
            Attachment plot-t8766-HSC-I-psfHsmTraceDiff_-psfMagHist.png [ 29468 ]
            Attachment plot-t8766-HSC-I-overlap_modelfit_CModel-sky-gals.png [ 29469 ]
            Attachment plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-gals.png [ 29470 ]
            Attachment plot-t8766-HSC-I-overlap_base_GaussianFlux-psfMagHist.png [ 29471 ]
            Attachment plot-t8766-HSC-I-mag_base_GaussianFlux-psfMagHist.png [ 29472 ]
            Attachment plot-t8766-HSC-I-footNpix-sky-stars.png [ 29473 ]
            Attachment plot-t8766-HSC-I-footNpix_calib_psfUsed-sky-stars.png [ 29474 ]
            Attachment plot-t8766-HSC-I-deconvMom-sky-stars.png [ 29475 ]
            Attachment plot-t8766-HSC-I-deconvMom-psfMagHist.png [ 29476 ]
            Attachment plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-psfMagHist.png [ 29477 ]
            Attachment plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-stars.png [ 29478 ]
            Attachment plot-t8766-HSC-I-overlap_modelfit_CModel-sky-stars.png [ 29479 ]
            Attachment plot-t8766-HSC-I-overlap_distance-sky-gals.png [ 29480 ]
            Attachment plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-stars.png [ 29481 ]
            Attachment plot-t8766-HSC-I-e1Resids_-sky-stars.png [ 29482 ]
            Attachment plot-t8766-HSC-I-compareUnforced_modelfit_CModel-psfMagHist.png [ 29483 ]
            Attachment plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-stars.png [ 29484 ]
            swinbank John Swinbank made changes -
            Sprint DRP S17-5 [ 364 ] DRP S17-5, DRP S17-6 [ 364, 365 ]
            swinbank John Swinbank made changes -
            Rank Ranked higher
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            I have now run tract 8766 (all 5 filters) through the lastest QA plotting scripts, which incorporate Paul Price's improvements/speedups into the latest version of these scripts that Lauren MacArthur handed off to me. They are on lsst-dev at /home/tmorton/RCplots/w17-hchiang/plots.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - I have now run tract 8766 (all 5 filters) through the lastest QA plotting scripts, which incorporate Paul Price 's improvements/speedups into the latest version of these scripts that Lauren MacArthur handed off to me. They are on lsst-dev at /home/tmorton/RCplots/w17-hchiang/plots .
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            Here is the latest version of the HSC-I/tract 8766 plots, and the ellipticity residuals pulled out, since that was of interest to Bob Armstrong.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Here is the latest version of the HSC-I/tract 8766 plots, and the ellipticity residuals pulled out, since that was of interest to Bob Armstrong .
            tmorton Tim Morton [X] (Inactive) made changes -
            Attachment plot-t8766-HSC-I-ellipResids-quiver.png [ 29488 ]
            Attachment HSC-I.zip [ 29489 ]
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            (the new ellipResids looks identical to the old; I suppose this is either reassuring or not, depending on point of view.)

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - (the new ellipResids looks identical to the old; I suppose this is either reassuring or not, depending on point of view.)
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            The complete set of QA plots (coaddAnalysis and colorAnalysis) of Hsin-Fang Chiang's RC processing run (DM-10129) are on lsst-dev at ~tmorton/DM-10044/plots.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - The complete set of QA plots (coaddAnalysis and colorAnalysis) of Hsin-Fang Chiang 's RC processing run ( DM-10129 ) are on lsst-dev at ~tmorton/ DM-10044 /plots .
            tmorton Tim Morton [X] (Inactive) made changes -
            Reviewers Bob Armstrong [ rearmstr ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            Bob Armstrong If you can take a quick skim of these and confirm that there is nothing catastrophically wrong then I think that's sufficient for review.

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - Bob Armstrong If you can take a quick skim of these and confirm that there is nothing catastrophically wrong then I think that's sufficient for review.
            Hide
            rearmstr Bob Armstrong added a comment -

            Other than the ellipticity residuals, things look fine.

            Show
            rearmstr Bob Armstrong added a comment - Other than the ellipticity residuals, things look fine.
            rearmstr Bob Armstrong made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            tmorton Tim Morton [X] (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]

              People

              Assignee:
              tmorton Tim Morton [X] (Inactive)
              Reporter:
              swinbank John Swinbank
              Reviewers:
              Bob Armstrong
              Watchers:
              Bob Armstrong, John Swinbank, Lauren MacArthur, Tim Morton [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.