Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10482

Bad Ellipticity Residuals in HSC RC dataset for S17B.

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      6
    • Epic Link:
    • Sprint:
      DRP S17-6
    • Team:
      Data Release Production

      Description

      The ellipticity residuals from the HSC RC dataset processed in DM-10129 are much worse than the same dataset processed with the HSC stack. This ticket is to discover the problem with the LSST version.

        Attachments

        1. hsc_stack.png
          hsc_stack.png
          448 kB
        2. lsst_stack.png
          lsst_stack.png
          504 kB
        3. new_rho1.png
          new_rho1.png
          38 kB
        4. rho1_coadd.png
          rho1_coadd.png
          70 kB
        5. rho1_visits.png
          rho1_visits.png
          75 kB

          Issue Links

            Activity

            Hide
            lauren Lauren MacArthur added a comment -

            How much is the difference in colourbar/whisker length scale (0.40 vs. 0.27) influencing the visual appearance here?

            Show
            lauren Lauren MacArthur added a comment - How much is the difference in colourbar/whisker length scale (0.40 vs. 0.27) influencing the visual appearance here?
            Hide
            rearmstr Bob Armstrong added a comment -

            I don't think the color scale effects the size of the whiskers. So I don't think it makes a difference in this case.

            Show
            rearmstr Bob Armstrong added a comment - I don't think the color scale effects the size of the whiskers. So I don't think it makes a difference in this case.
            Hide
            rearmstr Bob Armstrong added a comment - - edited

            I have checked the correlation of the ellipticity residuals on the individual visits for tract 8766 and 8767 using both pipelines. The results agree well and LSST is actually doing slightly better.

            This means the problem is coming from the coaddition process. Here is the same plot, but for the same coadd tract:

            Show
            rearmstr Bob Armstrong added a comment - - edited I have checked the correlation of the ellipticity residuals on the individual visits for tract 8766 and 8767 using both pipelines. The results agree well and LSST is actually doing slightly better. This means the problem is coming from the coaddition process. Here is the same plot, but for the same coadd tract:
            Hide
            rearmstr Bob Armstrong added a comment -

            Jim Bosch suggested there may be a problem with the validPolygon being set in the individual visits. To test this, I reran using only the ccds from the central region of the camera. This did not make any improvement.

            Show
            rearmstr Bob Armstrong added a comment - Jim Bosch suggested there may be a problem with the validPolygon being set in the individual visits. To test this, I reran using only the ccds from the central region of the camera. This did not make any improvement.
            Hide
            rearmstr Bob Armstrong added a comment -

            I found that the ccd positions were not being updated in python once the meas_mosiac fit had finished due to the pybind11 wrapping. This meant that the incorrect solutions were written to disk. This has been fixed on DM-10688. I have confirmed that this fixes the problem for a limited set of visits.

            Show
            rearmstr Bob Armstrong added a comment - I found that the ccd positions were not being updated in python once the meas_mosiac fit had finished due to the pybind11 wrapping. This meant that the incorrect solutions were written to disk. This has been fixed on DM-10688 . I have confirmed that this fixes the problem for a limited set of visits.
            Hide
            swinbank John Swinbank added a comment -

            Waiting for Tim Morton [X] to do an RC dataset run with the DM-10688 fix in place to verify that this fixed it.

            (Tim, is that ticketed? Is it happening?)

            Show
            swinbank John Swinbank added a comment - Waiting for Tim Morton [X] to do an RC dataset run with the DM-10688 fix in place to verify that this fixed it. (Tim, is that ticketed? Is it happening?)
            Hide
            rearmstr Bob Armstrong added a comment -

            Here is the result of tract 8766 from the RC dataset with the pybind11 fix compared to the S16A HSC data:

            This looks good. I am closing this.

            Show
            rearmstr Bob Armstrong added a comment - Here is the result of tract 8766 from the RC dataset with the pybind11 fix compared to the S16A HSC data: This looks good. I am closing this.

              People

              Assignee:
              rearmstr Bob Armstrong
              Reporter:
              rearmstr Bob Armstrong
              Watchers:
              Bob Armstrong, John Swinbank, Lauren MacArthur
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.