Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-19015

HSC warp making is broken with doApplyUberCal=True

    Details

      Description

      makeCoaddTempExp.py with doApplyUberCal=True to use meas_mosaic outputs fail to build warps despite the input data exist. A small example to reproduce on lsst-dev is:

       

      makeCoaddTempExp.py /datasets/hsc/repo/ --rerun RC/w_2019_14/DM-18300:private/user/name --id tract=9615 filter=HSC-G patch=4,8 --selectId ccd=0..8^10..103 visit=26050^26036^26060^26032 
      

      This doesn't really "fail" (and no logs in ERROR or FATAL level) but instead gives many confusing/misleading warnings and produce no outputs:

       

      WARN 2019-04-08T01:32:59.059 makeCoaddTempExp (DataId(initialdata={'tract': 9615, 'filter': 'HSC-G', 'patch': '4,8'}, tag=set()))(makeCoaddTempExp.py:341)- Calexp DataId(initialdata={'ccd': 103, 'visit': 26032, 'pointing': 1179, 'filter': 'HSC-G', 'field': 'SSP_WIDE', 'dateObs': '2015-03-25', 'taiObs': '2015-03-25', 'expTime': 150.0, 'tract': 9615}
      , tag=set()) not found; skipping it: 'NoneType' object has no attribute'getInstFluxAtZeroMagnitude'
      

       

      The log is misleading; this is DM-16537 about the generic exceptions. I troubleshoot a bit and trace to this line
      https://github.com/lsst/meas_mosaic/blob/6e395ac11a625c877374f99e2bed771b427835b6/python/lsst/meas/mosaic/updateExposure.py#L103
      where a non-empty header is obtained but no photoCalib is returned (that photCalib is None there). Feels like a bug in afw or meas_mosaic files; I paused there to file this ticket. Besides the bug, it'd be nice if the None calib is caught earlier.

        Attachments

          Issue Links

            Activity

            hchiang2 Hsin-Fang Chiang created issue -
            hchiang2 Hsin-Fang Chiang made changes -
            Field Original Value New Value
            Link This issue relates to DM-16537 [ DM-16537 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue relates to DM-18300 [ DM-18300 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue is triggered by DM-10156 [ DM-10156 ]
            Parejkoj John Parejko made changes -
            Assignee John Parejko [ parejkoj ]
            Parejkoj John Parejko made changes -
            Assignee John Parejko [ parejkoj ]
            Parejkoj John Parejko made changes -
            Assignee John Parejko [ parejkoj ]
            Parejkoj John Parejko made changes -
            Reviewers Hsin-Fang Chiang [ hchiang2 ]
            Status To Do [ 10001 ] In Review [ 10004 ]
            Parejkoj John Parejko made changes -
            Sprint AP S19-5 [ 833 ]
            Team Alert Production [ 10300 ]
            Labels SciencePipelines
            Priority Undefined [ 10000 ] Critical [ 2 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-19265 [ DM-19265 ]
            Parejkoj John Parejko made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            swinbank John Swinbank made changes -
            Story Points 1
            yusra Yusra AlSayyad made changes -
            Link This issue blocks DM-17743 [ DM-17743 ]
            swinbank John Swinbank made changes -
            Epic Link DM-16742 [ 235428 ]

              People

              • Assignee:
                Parejkoj John Parejko
                Reporter:
                hchiang2 Hsin-Fang Chiang
                Reviewers:
                Hsin-Fang Chiang
                Watchers:
                Hsin-Fang Chiang, John Parejko, John Swinbank, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel