Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6818

Quality check LSST processing of RC dataset

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      5
    • Sprint:
      DRP F16-2, DRP F16-3, DRP F16-4, DRP F16-6, DRP S17-1
    • Team:
      Data Release Production

      Description

      Perform a quality analysis on the LSST processing of the RC dataset (DM-6816) in the same way as would be performed before an HSC data release.

        Attachments

        1. hscCoaddAnalysis-DM-6816-cosmos-all_shortSum.txt
          41 kB
        2. hscCoaddAnalysis-DM-6816-cosmos-all_sum.txt
          38 kB
        3. hscCoaddAnalysis-DM-6816-wide-all_shortSum.txt
          46 kB
        4. hscCoaddAnalysis-DM-6816-wide-all_sum.txt
          72 kB
        5. hscColorAnalysis-DM-6816-cosmos-HSC-G^HSC-R^HSC-I^HSC-Z^HSC-Y^NB0921_shortSum.txt
          4 kB
        6. hscColorAnalysis-DM-6816-cosmos-HSC-G^HSC-R^HSC-I^HSC-Z^HSC-Y^NB0921_sum.txt
          4 kB
        7. hscColorAnalysis-DM-6816-wide-HSC-G^HSC-R^HSC-I^HSC-Z^HSC-Y_shortSum.txt
          4 kB
        8. hscColorAnalysis-DM-6816-wide-HSC-G^HSC-R^HSC-I^HSC-Z^HSC-Y_sum.txt
          7 kB
        9. hscVisitAnalysis-DM-6816-cosmos-all_shortSum.txt
          41 kB
        10. hscVisitAnalysis-DM-6816-cosmos-all_sum.txt
          399 kB
        11. hscVisitAnalysis-DM-6816-wide-all_shortSum.txt
          31 kB
        12. hscVisitAnalysis-DM-6816-wide-all_sum.txt
          200 kB
        13. plot-t0-gri-fit.png
          plot-t0-gri-fit.png
          45 kB
        14. plot-t0-gri-psfMagHist.png
          plot-t0-gri-psfMagHist.png
          100 kB
        15. plot-t0-gri-sky-stars.png
          plot-t0-gri-sky-stars.png
          114 kB
        16. plot-t0-HSC-I-mag_modelfit_CModel-psfMagHist_HSC_Stack.png
          plot-t0-HSC-I-mag_modelfit_CModel-psfMagHist_HSC_Stack.png
          147 kB
        17. plot-t0-HSC-I-mag_modelfit_CModel-psfMagHist.png
          plot-t0-HSC-I-mag_modelfit_CModel-psfMagHist.png
          149 kB
        18. plot-t0-HSC-I-mag_modelfit_CModel-sky-gals.png
          plot-t0-HSC-I-mag_modelfit_CModel-sky-gals.png
          280 kB
        19. plot-t0-HSC-I-mag_modelfit_CModel-sky-stars.png
          plot-t0-HSC-I-mag_modelfit_CModel-sky-stars.png
          262 kB
        20. plot-v1228-hsmTrace_-psfMagHist.png
          plot-v1228-hsmTrace_-psfMagHist.png
          118 kB
        21. plot-v1228-hsmTrace_-sky-stars.png
          plot-v1228-hsmTrace_-sky-stars.png
          256 kB
        22. plot-v1228-mag_base_GaussianFlux-psfMagHist.png
          plot-v1228-mag_base_GaussianFlux-psfMagHist.png
          138 kB
        23. plot-v1228-mag_base_GaussianFlux-sky-gals.png
          plot-v1228-mag_base_GaussianFlux-sky-gals.png
          255 kB
        24. plot-v1228-mag_base_GaussianFlux-sky-stars.png
          plot-v1228-mag_base_GaussianFlux-sky-stars.png
          279 kB

          Issue Links

            Activity

            Hide
            lauren Lauren MacArthur added a comment - - edited

            The attached txt files provide side-by-side statistics for the LSST and HSC RC dataset runs for various internal comparisons (direct comparisons of matched source between the two runs will be presented in DM-6817). The *_sum.txt show the per visit/tract results, whereas the *_shortSum.txt show just the averages over the visit/tract entries.

            hscVisitAnalysis => single frame measurement results
            hscCoaddAnalysis => coadd measurement results
            hscColorAnalysis => stellar locus on coadds

            All of the diagnostics shown have accompanying figures. Several example plots are also attached (these are all from the LSST runs. The associated HSC run figures have also been generated.)

            See DM-6816 for a summary of the astrometric and photometric metric comparisons (after running meas_mosaic).

            Show
            lauren Lauren MacArthur added a comment - - edited The attached txt files provide side-by-side statistics for the LSST and HSC RC dataset runs for various internal comparisons (direct comparisons of matched source between the two runs will be presented in DM-6817 ). The * _sum.txt show the per visit/tract results, whereas the * _shortSum.txt show just the averages over the visit/tract entries. hscVisitAnalysis => single frame measurement results hscCoaddAnalysis => coadd measurement results hscColorAnalysis => stellar locus on coadds All of the diagnostics shown have accompanying figures. Several example plots are also attached (these are all from the LSST runs. The associated HSC run figures have also been generated.) See DM-6816 for a summary of the astrometric and photometric metric comparisons (after running meas_mosaic ).
            Hide
            swinbank John Swinbank added a comment - - edited

            There's some analysis of these results on DM-6817, but I'm not sure if there's any further commentary to come on this story. Lauren MacArthur, can you provide a brief summary of the results, please?

            Show
            swinbank John Swinbank added a comment - - edited There's some analysis of these results on DM-6817 , but I'm not sure if there's any further commentary to come on this story. Lauren MacArthur , can you provide a brief summary of the results, please?
            Hide
            lauren Lauren MacArthur added a comment - - edited

            The recently created tickets DM-8532 & DM-8533 capture the most pressing issues, as revealed by this ticket and DM-6817, to get to the bottom of. From discussions in the regular Monday morning meeting here at Princeton, I will be focussing first on a look at the brightest stars being used in the psf modeling looking in particular at their footprints and distribution of peaks (as a function of distance from the centroid).

            For direct comparison of the plot that revealed the main issues (see comments in DM-6817), I have also attached the HSC version. So, compare:
            LSST stack

            with
            HSC stack

            The "bump" at bright magnitudes is not present in the latter and the large density of objects that have likely been misclassified as galaxies (namely the strip of red objects just below the threshold for the star/galaxy classification) in the LSST stack plot has much lower density in the HSC plot.

            Show
            lauren Lauren MacArthur added a comment - - edited The recently created tickets DM-8532 & DM-8533 capture the most pressing issues, as revealed by this ticket and DM-6817 , to get to the bottom of. From discussions in the regular Monday morning meeting here at Princeton, I will be focussing first on a look at the brightest stars being used in the psf modeling looking in particular at their footprints and distribution of peaks (as a function of distance from the centroid). For direct comparison of the plot that revealed the main issues (see comments in DM-6817 ), I have also attached the HSC version. So, compare: LSST stack with HSC stack The "bump" at bright magnitudes is not present in the latter and the large density of objects that have likely been misclassified as galaxies (namely the strip of red objects just below the threshold for the star/galaxy classification) in the LSST stack plot has much lower density in the HSC plot.

              People

              • Assignee:
                lauren Lauren MacArthur
                Reporter:
                swinbank John Swinbank
                Watchers:
                John Swinbank, Lauren MacArthur
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel