Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6588

Adapt qa analysis script for LSST vs. HSC coadd processing comparison

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      4
    • Sprint:
      DRP F16-4, DRP F16-5, DRP F16-6, DRP S17-1
    • Team:
      Data Release Production

      Description

      The analysis script was adapted for single visit processing comparisons in DM-4393 and DM-4730. Do the same here for coadd processing comparisons.

        Attachments

          Issue Links

            Activity

            Hide
            swinbank John Swinbank added a comment -

            Given that DM-6817 shows a bunch of comparisons, I guess a lot of this work has already taken place. Do we have an ETA for completion?

            Show
            swinbank John Swinbank added a comment - Given that DM-6817 shows a bunch of comparisons, I guess a lot of this work has already taken place. Do we have an ETA for completion?
            Hide
            lauren Lauren MacArthur added a comment - - edited

            The scripts have been updated for coadd processing analysis (see DM-6817 & DM-6818 for examples of the figures generated). In the context of a single processing run, the following plots are generated, each with a scatter plot of quantity vs. psf Mag with histograms of both axes and the distribution of quantity per source on the sky (to identify any potential spatial variations):

            The following use the forced measurements:

            mag_base_CircularApertureFlux_12_0 - mag-base_Psf
            mag_base_GaussianFlux-psfMagHist - mag-base_Psf
            mag_ext_photometryKron_KronFlux-psfMagHist - mag-base_Psf
            mag_modelfit_CModel-psfMagHist - mag-base_Psf
            

            The following compare the forced and unforced values for a given source:

            compareUnforced_base_CircularApertureFlux_12 - mag-base_Psf
            compareUnforced_base_GaussianFlux-psfMagHist - mag-base_Psf
            compareUnforced_ext_photometryKron_KronFlux - mag-base_Psf
            compareUnforced_modelfit_CModel-psfMagHist - mag-base_Psf
            

            In the following, "matches" refers to sources matched to a reference catalog (PanSTARRS in this case):

            matches_mag
            matches_ra
            matches_dec
            matches_distance
            

            In the following, "overlap" refers to matched sources in the patch overlap regions:

            overlap_base_CircularApertureFlux_12_0
            overlap_base_GaussianFlux
            overlap_distance
            overlap_ext_photometryKron_KronFlux
            overlap_modelfit_CModel
            deconvMom
            pStar
            

            Show
            lauren Lauren MacArthur added a comment - - edited The scripts have been updated for coadd processing analysis (see DM-6817 & DM-6818 for examples of the figures generated). In the context of a single processing run, the following plots are generated, each with a scatter plot of quantity vs. psf Mag with histograms of both axes and the distribution of quantity per source on the sky (to identify any potential spatial variations): The following use the forced measurements: mag_base_CircularApertureFlux_12_0 - mag-base_Psf mag_base_GaussianFlux-psfMagHist - mag-base_Psf mag_ext_photometryKron_KronFlux-psfMagHist - mag-base_Psf mag_modelfit_CModel-psfMagHist - mag-base_Psf The following compare the forced and unforced values for a given source: compareUnforced_base_CircularApertureFlux_12 - mag-base_Psf compareUnforced_base_GaussianFlux-psfMagHist - mag-base_Psf compareUnforced_ext_photometryKron_KronFlux - mag-base_Psf compareUnforced_modelfit_CModel-psfMagHist - mag-base_Psf In the following, "matches" refers to sources matched to a reference catalog (PanSTARRS in this case): matches_mag matches_ra matches_dec matches_distance In the following, "overlap" refers to matched sources in the patch overlap regions: overlap_base_CircularApertureFlux_12_0 overlap_base_GaussianFlux overlap_distance overlap_ext_photometryKron_KronFlux overlap_modelfit_CModel deconvMom pStar
            Hide
            lauren Lauren MacArthur added a comment -

            The current version of the script lives in the u/lauren/working branch of the lsst-dm/pipe-analysis repo: https://github.com/lsst-dm/pipe_analysis/tree/u/lauren/working

            The work of DM-6816, DM-6817, & DM-6818 has revealed additions and modifications that will help with the QA (identifying the root of the issues of DM-8532 & DM-8533 in particular), so the final clean-up of the script and merging it to the master branch will await those adaptations.

            Show
            lauren Lauren MacArthur added a comment - The current version of the script lives in the u/lauren/working branch of the lsst-dm/pipe-analysis repo: https://github.com/lsst-dm/pipe_analysis/tree/u/lauren/working The work of DM-6816 , DM-6817 , & DM-6818 has revealed additions and modifications that will help with the QA (identifying the root of the issues of DM-8532 & DM-8533 in particular), so the final clean-up of the script and merging it to the master branch will await those adaptations.

              People

              • Assignee:
                lauren Lauren MacArthur
                Reporter:
                lauren Lauren MacArthur
                Watchers:
                John Swinbank, Lauren MacArthur
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel