Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-31401

Generate updated HSC full focal plane SKY calibration frames

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: cp_pipe, pipe_drivers
    • Labels:
      None
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      It has come to our attention that we have been using largely outdated versions of the full-visit global SKY correction calibration frames in our processing of HSC data.  It seems that, while we have been keeping up with the updates to the sky correction algorithms, we failed to regenerate them so we are still using very old versions.  We would like to make sure we are using versions as close as possible to those certified and in use for the official HSC-SSP processing.

        Attachments

          Issue Links

            Activity

            Hide
            lauren Lauren MacArthur added a comment -

            The following plot highlights just how significant the difference is:

            left panel: SKY frame we are currently using (generated circa 2018)
            middle panel: SKY frame created with a more modern stack (after significant changes of DM- were merged)
            right panel: difference image

            Show
            lauren Lauren MacArthur added a comment - The following plot highlights just how significant the difference is: left panel: SKY frame we are currently using (generated circa 2018) middle panel: SKY frame created with a more modern stack (after significant changes of DM- were merged) right panel : difference image
            Hide
            lauren Lauren MacArthur added a comment - - edited

            Some considerations should be taken into account before proceeding:

            1. Do we want to re-generate for the full PDR2 dataset?
            2. Which exposures to include (e.g 30sec, non-science CCDs, rotational dithers, etc.)?
            3. Should this effort wait until post gen2?
            Show
            lauren Lauren MacArthur added a comment - - edited Some considerations should be taken into account before proceeding: Do we want to re-generate for the full PDR2 dataset? Which exposures to include (e.g 30sec, non-science CCDs, rotational dithers, etc.)? Should this effort wait until post gen2?
            Hide
            lskelvin Lee Kelvin added a comment -

            Thanks Lauren MacArthur. I've set up DM-32378 to work on this, folding in the new amp-offset corrections implemented in DM-24389. If it's okay with you, I'll mark this ticket as Won't Fix, and continue future sky frame efforts over on the other ticket.

            Show
            lskelvin Lee Kelvin added a comment - Thanks Lauren MacArthur . I've set up DM-32378 to work on this, folding in the new amp-offset corrections implemented in DM-24389 . If it's okay with you, I'll mark this ticket as Won't Fix , and continue future sky frame efforts over on the other ticket.
            Hide
            lauren Lauren MacArthur added a comment -

            Sounds good to me!

            Show
            lauren Lauren MacArthur added a comment - Sounds good to me!
            Hide
            lskelvin Lee Kelvin added a comment -

            Thanks Lauren, marking it now. Please see DM-32378 for further updates.

            Show
            lskelvin Lee Kelvin added a comment - Thanks Lauren, marking it now. Please see DM-32378 for further updates.

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              lauren Lauren MacArthur
              Watchers:
              Jim Bosch, Lauren MacArthur, Lee Kelvin, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.