Details
-
Type:
Bug
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: pipe_base
-
Labels:None
-
Team:Architecture
Description
When running multibandDriver.py on a fairly large dataset (see DM-6816), I am encountering many error messages along the lines of:
5547 FATAL multiBandDriver.measureCoaddSources.deblend: SourceDeblendTask.metadata.add(name='runEndInvoluntaryContextSwitches', value=13810175634) failed with error=Overflow error converting to int
|
7769 FATAL multiBandDriver.measureCoaddSources.match.refObjLoader: LoadAstrometryNetObjectsTask.metadata.add(name='loadSkyCircleStartInvoluntaryContextSwitches', value=9892578161) failed with error=Overflow error converting to int
|
So it seems this is a bug in daf_base's PropertySet/PropertyList add function. Might this be related to the py3 conversion?
Also note that this is not FATAL in the sense that it does not bring the whole run to a halt.
Attachments
Activity
Jenkins failed on Centos7 Py2, but I think it was a transient error in skymap as Flake8 checking was being turned on.
The original obj.metadata.add is now unprotected by the try block. Do you believe all reasons for embedding it in a try block in the first place have been dealt with by this change?
Paul Price
added a comment - The original obj.metadata.add is now unprotected by the try block. Do you believe all reasons for embedding it in a try block in the first place have been dealt with by this change? Yes, based on reading the original code and its motivation, and I believe that any other reasons indicate severe enough problems (hinted at by the previous FATAL log message) that should indeed throw exceptions rather than having them be trapped.
Merged in a695220.
Thank you KT!