Details
-
Type:
Bug
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: pipe_drivers
-
Labels:None
-
Story Points:1
-
Epic Link:
-
Team:Data Release Production
-
Urgent?:No
Description
I ran a PTC task on BOT run 12606, the first time we have the full LSSTCam. Six CCDs failed to return results. I am tracking down the reasons. CCD R41_S11, detector=166 failed because it failed to create a master dark with the error "Too many CR pixels (max 100000)". Below is a command line that reproduces the error, as well as the error string itself. I'm also attaching the dark image, which looks fine. FWIW, I have seen this error before on several occasions, so this is not an isolated incident.
Command line:
constructDark.py /project/shared/BOT --calib /project/shared/BOT/rerun/cslage/PTC_LSSTCAM_12606/CALIB --rerun /project/shared/BOT/rerun/cslage/PTC_LSSTCAM_Test --batch-type=smp --cores 1 -c isr.doCrosstalk=False isr.overscan.fitType=MEDIAN_PER_ROW isr.overscan.order=1 --id expId=3020100800045 detector=166 |
Error:
dark WARN: Unable to process DataId(initialdata={'expId': 3020100800045, 'detector': 166, 'dayObs': '2020-10-08', 'raftName': 'R41', 'detectorName': 'S11', 'snap': 0}, tag=set()): |
File "src/CR.cc", line 410, in std::vector<std::shared_ptr<lsst::afw::detection::Footprint> > lsst::meas::algorithms::findCosmicRays(MaskedImageT&, const lsst::afw::detection::Psf&, double, const lsst::daf::base::PropertySet&, bool) [with MaskedImageT = lsst::afw::image::MaskedImage<float>] |
Too many CR pixels (max 100000) {0} |
lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 100000)'LengthError on lsst-devl01:2455582 in reduce: |
File "src/CR.cc", line 410, in std::vector<std::shared_ptr<lsst::afw::detection::Footprint> > lsst::meas::algorithms::findCosmicRays(MaskedImageT&, const lsst::afw::detection::Psf&, double, const lsst::daf::base::PropertySet&, bool) [with MaskedImageT = lsst::afw::image::MaskedImage<float>] |
Too many CR pixels (max 100000) {0} |
lsst::pex::exceptions::LengthError: 'Too many CR pixels (max 100000)' |
Attachments
Issue Links
- blocks
-
DM-27161 PTC BOT issues.
- Done
Thinking through this again, and trying to place fixes at various different levels, I came to what is likely the best solution for now:
constructDark.py /project/shared/BOT \
--calib /project/shared/BOT/rerun/cslage/PTC_LSSTCAM_New_12606/CALIB \
isr.doEmpiricalReadNoise=True \
Setting `doEmpiricalReadNoise` forces ISR to ignore the camera defined read noise levels and independently estimate it from the data. This provides a better variance to the CR code, and it then flags a much smaller number of pixels (132 CR found on 3020100800045).
Once
DM-27010is complete, we will be able to supply a PTC dataset to ISR, and pull gain and read noise values from there instead of from the camera definition. I think this means that creating initial calibrations for a camera is going to need to iterate: