Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9383

Investigate propagation of visit flags for certain patches in HSC RC processing

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_tasks
    • Labels:
      None
    • Story Points:
      3
    • Epic Link:
    • Team:
      Data Release Production

      Description

      For certain diagnostics plots, it is useful to select on specific subsets of the data. An example subset would be the objects that were used actually in the PSF modeling, i.e. those with flag calib_psfUsed=True. When plotting this subset for the coadds of the LSST stack processing of the HSC RC dataset (DM-6816), a large number of patches have no objects for which this flag is set. While the list is not expected to be identical to the list from the visit processing (the flag is propagated based on the fraction of visits overlapping that object and contributing to the coadd that had the flag set for said object), ending up with a list of zero objects used for PSF modeling should be very unlikely. The pattern is quite delineated, with sharp truncation lines beyond which no objects used in PSF modeling are found:

      Of note, this does not happen for the same dataset processed through the HSC 4.0.5 stack (DM-9028):

        Attachments

          Issue Links

            Activity

            Hide
            lauren Lauren MacArthur added a comment -

            This was tracked down to the following line in propagateVisitFlags.py:
            https://github.com/lsst/pipe_tasks/blob/master/python/lsst/pipe/tasks/propagateVisitFlags.py#L186
            and ultimately to an issue with the persisted WCS's from meas_mosaic from rotated CCDs. The issue is being fixed on DM-9862.

            Show
            lauren Lauren MacArthur added a comment - This was tracked down to the following line in propagateVisitFlags.py: https://github.com/lsst/pipe_tasks/blob/master/python/lsst/pipe/tasks/propagateVisitFlags.py#L186 and ultimately to an issue with the persisted WCS's from meas_mosaic from rotated CCDs. The issue is being fixed on DM-9862 .
            Hide
            lauren Lauren MacArthur added a comment -

            John Swinbank, ok to mark this as done (issue identified and being fixed on DM-9862)?

            Show
            lauren Lauren MacArthur added a comment - John Swinbank , ok to mark this as done (issue identified and being fixed on DM-9862 )?
            Hide
            swinbank John Swinbank added a comment -

            Thanks!

            Show
            swinbank John Swinbank added a comment - Thanks!

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              lauren Lauren MacArthur
              Reviewers:
              John Swinbank
              Watchers:
              John Swinbank, Lauren MacArthur, Tim Morton [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.