Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16593

Decam VisitInfo ExposureId set incorrectly

    XMLWordPrintable

    Details

    • Team:
      DM Science

      Description

      Chris Morrison [X] and Meredith Rawls discovered that the updates to metadata handling uncovered a latent bug in DecamMapper.std_raw(), which used the header from HDU 1 to set the Exposure ID in VisitInfo instead of the header for the appropriate HDU. The fix is to use the correct HDU metadata.

        Attachments

          Activity

          No builds found.
          ctslater Colin Slater created issue -
          ctslater Colin Slater made changes -
          Field Original Value New Value
          Assignee Colin Slater [ ctslater ]
          Hide
          ctslater Colin Slater added a comment -

          Passed Centos jenkins, waiting on Mac OS. Giving to Chris Morrison [X] for review, but Hsin-Fang Chiang might also want to take a glance.

          Show
          ctslater Colin Slater added a comment - Passed Centos jenkins, waiting on Mac OS. Giving to Chris Morrison [X] for review, but Hsin-Fang Chiang might also want to take a glance.
          ctslater Colin Slater made changes -
          Reviewers Chris Morrison [ cmorrison ]
          Status To Do [ 10001 ] In Review [ 10004 ]
          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          No pull request so I'm commenting here...
          Since you're on it, may you please also correct the outdated comments in line 238-240 in decamMapper.py? Looks like that was the original reason to want the first HDU back then and got outdated with the makeRawVisitInfo work.

          Also, a similar pattern of getting the "md0" exist in other places of the file. Is there more that could use a cleanup? 

          And, I'm not sure how good the DECam processing test coverage is on Jenkins today, so maybe somebody would want to run some manual tests or at least include lsst_ci

          Show
          hchiang2 Hsin-Fang Chiang added a comment - No pull request so I'm commenting here... Since you're on it, may you please also correct the outdated comments in line 238-240 in decamMapper.py ? Looks like that was the original reason to want the first HDU back then and got outdated with the makeRawVisitInfo work. Also, a similar pattern of getting the "md0" exist in other places of the file. Is there more that could use a cleanup?  And, I'm not sure how good the DECam processing test coverage is on Jenkins today, so maybe somebody would want to run some manual tests or at least include lsst_ci
          Hide
          hchiang2 Hsin-Fang Chiang added a comment -

          Never mind the very last point; lsst_ci is included by default.

          Show
          hchiang2 Hsin-Fang Chiang added a comment - Never mind the very last point; lsst_ci is included by default.
          Hide
          cmorrison Chris Morrison [X] (Inactive) added a comment -

          I'm currently running the `ap_verify_hits2015` dataset using this ticket and have not seen any errors coming from this ticket. Colin Slater and I have confirmed that it produces the correct ExposureIds for the data.

          Show
          cmorrison Chris Morrison [X] (Inactive) added a comment - I'm currently running the `ap_verify_hits2015` dataset using this ticket and have not seen any errors coming from this ticket. Colin Slater and I have confirmed that it produces the correct ExposureIds for the data.
          Hide
          ctslater Colin Slater added a comment -

          Thanks for having a look, Hsin-Fang Chiang. Outdated comment removed. I'm all for getting rid of the other "md0" activity. I pushed a new commit that implements the same change (and a test) for instcals. For darks and cpMasterCals though it looks like we don't have test coverage of those, so I'm inclined to leave them as-is for the moment. Jenkins in progress.

          Show
          ctslater Colin Slater added a comment - Thanks for having a look, Hsin-Fang Chiang . Outdated comment removed. I'm all for getting rid of the other "md0" activity. I pushed a new commit that implements the same change (and a test) for instcals. For darks and cpMasterCals though it looks like we don't have test coverage of those, so I'm inclined to leave them as-is for the moment. Jenkins in progress.
          cmorrison Chris Morrison [X] (Inactive) made changes -
          Status In Review [ 10004 ] Reviewed [ 10101 ]
          Hide
          ctslater Colin Slater added a comment -

          Merged to master.

          Show
          ctslater Colin Slater added a comment - Merged to master.
          ctslater Colin Slater made changes -
          Resolution Done [ 10000 ]
          Status Reviewed [ 10101 ] Done [ 10002 ]

            People

            Assignee:
            ctslater Colin Slater
            Reporter:
            ctslater Colin Slater
            Reviewers:
            Chris Morrison [X] (Inactive)
            Watchers:
            Chris Morrison [X] (Inactive), Colin Slater, Hsin-Fang Chiang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.