Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: Science Pipelines
-
Labels:
-
Story Points:4
-
Epic Link:
-
Sprint:AP S19-5
-
Team:Alert Production
Description
Some CCDs in the HSC-RC2 reprocessing show this warning:
processCcd.calibrate.astrometry.matcher WARN: Number of matches is smaller than request
|
This probably should be an error on the matcher, but it seems to be passed to the fitter and then report as a successful fit.
A few data IDs of interest are visit=1872 ccd=11 visit=1868 ccd=13 visit=22648 ccd=4.
The first CCD
processCcd.calibrate.astromRefObjLoader INFO: Loaded 1580 reference objects
|
processCcd.calibrate.astrometry.matcher INFO: Purged 661 sources, leaving 113 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 25 sources
|
processCcd.calibrate.astrometry.matcher WARN: Number of matches is smaller than request
|
processCcd.calibrate.astrometry.matcher INFO: Purged 661 sources, leaving 113 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 1 sources
|
processCcd.calibrate.astrometry.matcher WARN: Number of matches is smaller than request
|
processCcd.calibrate.astrometry INFO: Fit WCS iter 2 failed; using previous iteration:
|
File "src/sip/CreateWcsWithSip.cc", line 131, in lsst::meas::astrom::sip::CreateWcsWithSip<MatchT>::CreateWcsWithSip(const std::vector<T>&, const lsst::afw::geom::SkyWcs&, int, const lsst::geom::Box2I&, int) [with MatchT = lsst::afw::table::Match<lsst::afw::table::SimpleRecord, lsst::afw::table::SourceRecord>]
|
Number of matches less than requested sip order {0}
|
lsst::pex::exceptions::LengthError: 'Number of matches less than requested sip order'
|
|
processCcd.calibrate.astrometry INFO: Matched and fit WCS in 1 iterations; found 25 matches with scatter = 0.028 +- 0.019 arcsec
|
The second
processCcd.calibrate.astromRefObjLoader INFO: Loaded 1840 reference objects
|
processCcd.calibrate.astrometry.matcher INFO: Purged 595 sources, leaving 133 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 27 sources
|
processCcd.calibrate.astrometry.matcher WARN: Number of matches is smaller than request
|
processCcd.calibrate.astrometry.matcher INFO: Purged 595 sources, leaving 133 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 4 sources
|
processCcd.calibrate.astrometry.matcher WARN: Number of matches is smaller than request
|
processCcd.calibrate.astrometry INFO: Fit WCS iter 2 failed; using previous iteration: All matches rejected in iteration 1
|
processCcd.calibrate.astrometry INFO: Matched and fit WCS in 1 iterations; found 27 matches with scatter = 0.092 +- 0.049 arcsec
|
And the third
processCcd.calibrate.astromRefObjLoader INFO: Loaded 1441 reference objects
|
processCcd.calibrate.astrometry.matcher INFO: Purged 1109 sources, leaving 99 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 47 sources
|
processCcd.calibrate.astrometry.matcher INFO: Purged 1109 sources, leaving 99 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 49 sources
|
processCcd.calibrate.astrometry.matcher INFO: Purged 1109 sources, leaving 99 good sources
|
processCcd.calibrate.astrometry.matcher INFO: Matched 27 sources
|
processCcd.calibrate.astrometry.matcher WARN: Number of matches is smaller than request
|
processCcd.calibrate.astrometry INFO: Matched and fit WCS in 3 iterations; found 27 matches with scatter = 0.029 +- 0.020 arcsec
|
The logs are from using the w_2019_10 stack. But the LengthError has appeared since w_2019_07, and the Number of matches is smaller than request warnings have been around for longer.
Attachments
Issue Links
- relates to
-
DM-17940 Reprocess RC2 with w_2019_10
- Done
I was able to address the issue simply by softening one of the config parameters. Specifically, I changed the number of reference objects at which the matcher always uses pessemistic mode from 2k to 1k. This causes the three above warnings be completely successful.
I'm running the change though the validate_drp. I've confirmed that the values for cfht and decam and uneffected but need a bit of time to run over the HSC data.