Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10044

Produce QA plots

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      3
    • Epic Link:
    • Sprint:
      DRP S17-5, DRP S17-6
    • Team:
      Data Release Production

      Description

      Take the scripts provided by Lauren MacArthur and apply them to a reprocessing of the HSC RC dataset (either that generated by DM-10043 or some other recent job) to generate the "standard" series of QA plots.

        Attachments

        1. HSC-I.zip
          14.84 MB
        2. plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-psfMagHist.png
          plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-psfMagHist.png
          158 kB
        3. plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-gals.png
          plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-gals.png
          307 kB
        4. plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-stars.png
          plot-t8766-HSC-I-compareUnforced_base_GaussianFlux-sky-stars.png
          294 kB
        5. plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-psfMagHist.png
          plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-psfMagHist.png
          143 kB
        6. plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-gals.png
          plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-gals.png
          308 kB
        7. plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-stars.png
          plot-t8766-HSC-I-compareUnforced_ext_photometryKron_KronFlux-sky-stars.png
          296 kB
        8. plot-t8766-HSC-I-compareUnforced_modelfit_CModel-psfMagHist.png
          plot-t8766-HSC-I-compareUnforced_modelfit_CModel-psfMagHist.png
          125 kB
        9. plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-gals.png
          plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-gals.png
          283 kB
        10. plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-stars.png
          plot-t8766-HSC-I-compareUnforced_modelfit_CModel-sky-stars.png
          277 kB
        11. plot-t8766-HSC-I-deconvMom-psfMagHist.png
          plot-t8766-HSC-I-deconvMom-psfMagHist.png
          169 kB
        12. plot-t8766-HSC-I-deconvMom-sky-gals.png
          plot-t8766-HSC-I-deconvMom-sky-gals.png
          283 kB
        13. plot-t8766-HSC-I-deconvMom-sky-stars.png
          plot-t8766-HSC-I-deconvMom-sky-stars.png
          279 kB
        14. plot-t8766-HSC-I-e1Resids_-psfMagHist.png
          plot-t8766-HSC-I-e1Resids_-psfMagHist.png
          210 kB
        15. plot-t8766-HSC-I-e1Resids_-sky-stars.png
          plot-t8766-HSC-I-e1Resids_-sky-stars.png
          318 kB
        16. plot-t8766-HSC-I-e1ResidsHsm_-psfMagHist.png
          plot-t8766-HSC-I-e1ResidsHsm_-psfMagHist.png
          209 kB
        17. plot-t8766-HSC-I-e1ResidsHsm_-sky-stars.png
          plot-t8766-HSC-I-e1ResidsHsm_-sky-stars.png
          316 kB
        18. plot-t8766-HSC-I-ellipResids-quiver.png
          plot-t8766-HSC-I-ellipResids-quiver.png
          484 kB
        19. plot-t8766-HSC-I-ellipResids-quiver.png
          plot-t8766-HSC-I-ellipResids-quiver.png
          481 kB
        20. plot-t8766-HSC-I-footNpix_calib_psfUsed-psfMagHist.png
          plot-t8766-HSC-I-footNpix_calib_psfUsed-psfMagHist.png
          166 kB
        21. plot-t8766-HSC-I-footNpix_calib_psfUsed-sky-stars.png
          plot-t8766-HSC-I-footNpix_calib_psfUsed-sky-stars.png
          300 kB
        22. plot-t8766-HSC-I-footNpix-hist.png
          plot-t8766-HSC-I-footNpix-hist.png
          28 kB
        23. plot-t8766-HSC-I-footNpix-psfMagHist.png
          plot-t8766-HSC-I-footNpix-psfMagHist.png
          181 kB
        24. plot-t8766-HSC-I-footNpix-sky-gals.png
          plot-t8766-HSC-I-footNpix-sky-gals.png
          304 kB
        25. plot-t8766-HSC-I-footNpix-sky-stars.png
          plot-t8766-HSC-I-footNpix-sky-stars.png
          275 kB
        26. plot-t8766-HSC-I-hsmTrace_-psfMagHist.png
          plot-t8766-HSC-I-hsmTrace_-psfMagHist.png
          178 kB
        27. plot-t8766-HSC-I-hsmTrace_-sky-stars.png
          plot-t8766-HSC-I-hsmTrace_-sky-stars.png
          314 kB
        28. plot-t8766-HSC-I-mag_base_GaussianFlux-psfMagHist.png
          plot-t8766-HSC-I-mag_base_GaussianFlux-psfMagHist.png
          150 kB
        29. plot-t8766-HSC-I-mag_base_GaussianFlux-sky-gals.png
          plot-t8766-HSC-I-mag_base_GaussianFlux-sky-gals.png
          300 kB
        30. plot-t8766-HSC-I-mag_base_GaussianFlux-sky-stars.png
          plot-t8766-HSC-I-mag_base_GaussianFlux-sky-stars.png
          310 kB
        31. plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-psfMagHist.png
          plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-psfMagHist.png
          154 kB
        32. plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-gals.png
          plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-gals.png
          296 kB
        33. plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-stars.png
          plot-t8766-HSC-I-mag_ext_photometryKron_KronFlux-sky-stars.png
          310 kB
        34. plot-t8766-HSC-I-mag_modelfit_CModel-psfMagHist.png
          plot-t8766-HSC-I-mag_modelfit_CModel-psfMagHist.png
          113 kB
        35. plot-t8766-HSC-I-mag_modelfit_CModel-sky-gals.png
          plot-t8766-HSC-I-mag_modelfit_CModel-sky-gals.png
          289 kB
        36. plot-t8766-HSC-I-mag_modelfit_CModel-sky-stars.png
          plot-t8766-HSC-I-mag_modelfit_CModel-sky-stars.png
          289 kB
        37. plot-t8766-HSC-I-overlap_base_GaussianFlux-psfMagHist.png
          plot-t8766-HSC-I-overlap_base_GaussianFlux-psfMagHist.png
          143 kB
        38. plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-gals.png
          plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-gals.png
          146 kB
        39. plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-stars.png
          plot-t8766-HSC-I-overlap_base_GaussianFlux-sky-stars.png
          115 kB
        40. plot-t8766-HSC-I-overlap_distance-psfMagHist.png
          plot-t8766-HSC-I-overlap_distance-psfMagHist.png
          129 kB
        41. plot-t8766-HSC-I-overlap_distance-sky-gals.png
          plot-t8766-HSC-I-overlap_distance-sky-gals.png
          91 kB
        42. plot-t8766-HSC-I-overlap_distance-sky-stars.png
          plot-t8766-HSC-I-overlap_distance-sky-stars.png
          94 kB
        43. plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-psfMagHist.png
          plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-psfMagHist.png
          145 kB
        44. plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-gals.png
          plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-gals.png
          146 kB
        45. plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-stars.png
          plot-t8766-HSC-I-overlap_ext_photometryKron_KronFlux-sky-stars.png
          114 kB
        46. plot-t8766-HSC-I-overlap_modelfit_CModel-psfMagHist.png
          plot-t8766-HSC-I-overlap_modelfit_CModel-psfMagHist.png
          154 kB
        47. plot-t8766-HSC-I-overlap_modelfit_CModel-sky-gals.png
          plot-t8766-HSC-I-overlap_modelfit_CModel-sky-gals.png
          147 kB
        48. plot-t8766-HSC-I-overlap_modelfit_CModel-sky-stars.png
          plot-t8766-HSC-I-overlap_modelfit_CModel-sky-stars.png
          114 kB
        49. plot-t8766-HSC-I-psfHsmTraceDiff_-psfMagHist.png
          plot-t8766-HSC-I-psfHsmTraceDiff_-psfMagHist.png
          198 kB
        50. plot-t8766-HSC-I-psfHsmTraceDiff_-sky-stars.png
          plot-t8766-HSC-I-psfHsmTraceDiff_-sky-stars.png
          307 kB
        51. plot-t8766-HSC-I-psfTraceDiff_-psfMagHist.png
          plot-t8766-HSC-I-psfTraceDiff_-psfMagHist.png
          199 kB
        52. plot-t8766-HSC-I-psfTraceDiff_-sky-stars.png
          plot-t8766-HSC-I-psfTraceDiff_-sky-stars.png
          308 kB
        53. plot-t8766-HSC-I-pStar-psfMagHist.png
          plot-t8766-HSC-I-pStar-psfMagHist.png
          128 kB
        54. plot-t8766-HSC-I-pStar-sky-stars.png
          plot-t8766-HSC-I-pStar-sky-stars.png
          223 kB
        55. plot-t8766-HSC-I-trace_-psfMagHist.png
          plot-t8766-HSC-I-trace_-psfMagHist.png
          179 kB
        56. plot-t8766-HSC-I-trace_-sky-stars.png
          plot-t8766-HSC-I-trace_-sky-stars.png
          316 kB

          Issue Links

            Activity

            Hide
            tmorton Tim Morton added a comment -

            Here are the QA plots from tract 8766 of the RC-wide test pipeline run (from DM-10043). I ran this with -c doPlotMatches=False to avoid a as-yet-unsolved error.

            Show
            tmorton Tim Morton added a comment - Here are the QA plots from tract 8766 of the RC-wide test pipeline run (from DM-10043 ). I ran this with -c doPlotMatches=False to avoid a as-yet-unsolved error.
            Hide
            tmorton Tim Morton added a comment -

            I have now run tract 8766 (all 5 filters) through the lastest QA plotting scripts, which incorporate Paul Price's improvements/speedups into the latest version of these scripts that Lauren MacArthur handed off to me. They are on lsst-dev at /home/tmorton/RCplots/w17-hchiang/plots.

            Show
            tmorton Tim Morton added a comment - I have now run tract 8766 (all 5 filters) through the lastest QA plotting scripts, which incorporate Paul Price 's improvements/speedups into the latest version of these scripts that Lauren MacArthur handed off to me. They are on lsst-dev at /home/tmorton/RCplots/w17-hchiang/plots .
            Hide
            tmorton Tim Morton added a comment -

            Here is the latest version of the HSC-I/tract 8766 plots, and the ellipticity residuals pulled out, since that was of interest to Bob Armstrong.

            Show
            tmorton Tim Morton added a comment - Here is the latest version of the HSC-I/tract 8766 plots, and the ellipticity residuals pulled out, since that was of interest to Bob Armstrong .
            Hide
            tmorton Tim Morton added a comment -

            (the new ellipResids looks identical to the old; I suppose this is either reassuring or not, depending on point of view.)

            Show
            tmorton Tim Morton added a comment - (the new ellipResids looks identical to the old; I suppose this is either reassuring or not, depending on point of view.)
            Hide
            tmorton Tim Morton added a comment -

            The complete set of QA plots (coaddAnalysis and colorAnalysis) of Hsin-Fang Chiang's RC processing run (DM-10129) are on lsst-dev at ~tmorton/DM-10044/plots.

            Show
            tmorton Tim Morton added a comment - The complete set of QA plots (coaddAnalysis and colorAnalysis) of Hsin-Fang Chiang 's RC processing run ( DM-10129 ) are on lsst-dev at ~tmorton/ DM-10044 /plots .
            Hide
            tmorton Tim Morton added a comment -

            Bob Armstrong If you can take a quick skim of these and confirm that there is nothing catastrophically wrong then I think that's sufficient for review.

            Show
            tmorton Tim Morton added a comment - Bob Armstrong If you can take a quick skim of these and confirm that there is nothing catastrophically wrong then I think that's sufficient for review.
            Hide
            rearmstr Bob Armstrong added a comment -

            Other than the ellipticity residuals, things look fine.

            Show
            rearmstr Bob Armstrong added a comment - Other than the ellipticity residuals, things look fine.

              People

              • Assignee:
                tmorton Tim Morton
                Reporter:
                swinbank John Swinbank
                Reviewers:
                Bob Armstrong
                Watchers:
                Bob Armstrong, John Swinbank, Lauren MacArthur, Tim Morton
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel