Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-28985

Update Gen2 calibration policy formats in obs_subaru

    XMLWordPrintable

Details

    • 4
    • DRP S21a (Dec Jan)
    • Data Release Production
    • No

    Description

      The Gen2 obs_subaru policy file policy/HscMapper.yaml defines bias and dark calibrations to be of type ImageF, which, by definition, does not have mask or variance planes. On read, these are passed through a standardization step that converts ImageF to an ExposureF by adding empty mask and variance planes. However, when running a comparison test using Gen3 middleware (on DM-28936), it was revealed that these files do have variance and masks planes, it turns out these calibration files do have mask and variance planes and uses them when updating the variance planes throughout the processing. So, as it stands, Gen2 and Gen3 are behaving slightly differently leading to small (and very likely scientifically insignificant) differences, putting a dent in our efforts towards acheiving Gen2/Gen3 parity through Single Frame Processing. The fix is to update the bias and dark formats in the policy file from ImageF to MaskedImageF, which will be done here.

      Attachments

        Issue Links

          Activity

            lauren Lauren MacArthur created issue -
            lauren Lauren MacArthur made changes -
            Field Original Value New Value
            Link This issue relates to DM-28936 [ DM-28936 ]
            lauren Lauren MacArthur made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            lauren Lauren MacArthur made changes -
            Remote Link This issue links to "Page (Confluence)" [ 27723 ]
            lauren Lauren MacArthur made changes -
            Link This issue blocks DM-28858 [ DM-28858 ]
            lauren Lauren MacArthur made changes -
            Link This issue blocks DM-28858 [ DM-28858 ]
            lauren Lauren MacArthur made changes -
            Link This issue blocks DM-28936 [ DM-28936 ]
            lauren Lauren MacArthur made changes -
            lauren Lauren MacArthur made changes -
            lauren Lauren MacArthur made changes -
            lauren Lauren MacArthur made changes -
            lauren Lauren MacArthur made changes -
            lauren Lauren MacArthur made changes -
            Reviewers Christopher Waters [ cwaters ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            czw Christopher Waters made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            lauren Lauren MacArthur made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            lauren Lauren MacArthur made changes -
            Story Points 4
            yusra Yusra AlSayyad made changes -
            Epic Link DM-27956 [ 442730 ] DM-27975 [ 442760 ]
            lauren Lauren MacArthur made changes -
            Labels SciencePipelines SciencePipelines drp-parity
            lauren Lauren MacArthur made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28355 ]

            People

              lauren Lauren MacArthur
              lauren Lauren MacArthur
              Christopher Waters
              Christopher Waters, Jim Bosch, Lauren MacArthur, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.