Details
-
Type:
Bug
-
Status: Invalid
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: ip_isr
-
Labels:None
-
Team:Data Release Production
-
Urgent?:No
Description
When trying to run ISR on recent ComCam files, the ISR task can't find the dfect files. I've had this problem before, but I thought it was fixed. The files are there in the CALIB directory. I know the problem is the defect files, because if I change doDefect=True to doDefect=False, then the ISR runs and completes.
As I've said in the Slack messages, if the best fix is to move to Gen3, I'm open to doing this, but will need smoe guidance.
Here's the command line:
runIsr.py /project/shared/comCam --rerun /project/shared/comCam/rerun/cslage/PTC_2021-04-02 --calib /project/shared/comCam/rerun/cslage/PTC_2021-04-02/CALIB --id detector=4 expId=2021040200025 -c isr.doBias=True isr.doDark=True isr.doFringe=False isr.doSuspect=True isr.doDefect=True isr.overscan.fitType=MEDIAN_PER_ROW isr.overscan.order=1 isr.doFlat=False isr.doCrosstalk=False isr.edgeMaskLevel=AMP isr.numEdgeSuspect=10 --clobber-config --clobber-versions -j 1
|
and here's the error:
runIsr FATAL: Failed on dataId={'detector': 4, 'expId': 2021040200025, 'dayObs': '2021-04-02', 'raftName': 'R22', 'detectorName': 'S11'}: RuntimeError: No registry for lookup
|
Traceback (most recent call last):
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/pipe_base/21.0.0-16-g0fb55c1+b60e2d390c/python/lsst/pipe/base/cmdLineTask.py", line 431, in __call__
|
result = self.runTask(task, dataRef, kwargs)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/pipe_base/21.0.0-16-g0fb55c1+b60e2d390c/python/lsst/pipe/base/cmdLineTask.py", line 495, in runTask
|
return task.runDataRef(dataRef, **kwargs)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/ip_isr/21.0.0-11-g2b59f77+a9c1acf22d/python/lsst/ip/isr/isrTask.py", line 2657, in runDataRef
|
return self.isr.runDataRef(dataRef)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/pipe_base/21.0.0-16-g0fb55c1+b60e2d390c/python/lsst/pipe/base/timer.py", line 157, in wrapper
|
res = func(self, *args, **keyArgs)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/ip_isr/21.0.0-11-g2b59f77+a9c1acf22d/python/lsst/ip/isr/isrTask.py", line 1719, in runDataRef
|
isrData = self.readIsrData(sensorRef, ccdExposure)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/ip_isr/21.0.0-11-g2b59f77+a9c1acf22d/python/lsst/ip/isr/isrTask.py", line 1144, in readIsrData
|
defectList = (dataRef.get("defects")
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/daf_persistence/21.0.0-8-g5674e7b+d1bd76f71f/python/lsst/daf/persistence/butlerSubset.py", line 203, in get
|
return self.butlerSubset.butler.get(datasetType, self.dataId, **rest)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/daf_persistence/21.0.0-8-g5674e7b+d1bd76f71f/python/lsst/daf/persistence/butler.py", line 1399, in get
|
location = self._locate(datasetType, dataId, write=False)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/daf_persistence/21.0.0-8-g5674e7b+d1bd76f71f/python/lsst/daf/persistence/butler.py", line 1318, in _locate
|
location = repoData.repo.map(datasetType, dataId, write=write)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/daf_persistence/21.0.0-8-g5674e7b+d1bd76f71f/python/lsst/daf/persistence/repository.py", line 239, in map
|
loc = self._mapper.map(*args, **kwargs)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/daf_persistence/21.0.0-8-g5674e7b+d1bd76f71f/python/lsst/daf/persistence/mapper.py", line 165, in map
|
return func(self.validate(dataId), write)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/obs_base/21.0.0-46-g873c13b+6225f1ba97/python/lsst/obs/base/cameraMapper.py", line 392, in mapClosure
|
return mapping.map(mapper, dataId, write)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/obs_base/21.0.0-46-g873c13b+6225f1ba97/python/lsst/obs/base/mapping.py", line 460, in map
|
location = Mapping.map(self, mapper, dataId, write=write)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/obs_base/21.0.0-46-g873c13b+6225f1ba97/python/lsst/obs/base/mapping.py", line 155, in map
|
actualId = self.need(iter(self.keyDict.keys()), dataId)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/obs_base/21.0.0-46-g873c13b+6225f1ba97/python/lsst/obs/base/mapping.py", line 322, in need
|
lookups = self.lookup(newProps, newId)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/obs_base/21.0.0-46-g873c13b+6225f1ba97/python/lsst/obs/base/mapping.py", line 519, in lookup
|
return Mapping.lookup(self, properties, newId)
|
File "/software/lsstsw/stack_20210211/stack/miniconda3-py38_4.9.2-0.4.1/Linux64/obs_base/21.0.0-46-g873c13b+6225f1ba97/python/lsst/obs/base/mapping.py", line 209, in lookup
|
raise RuntimeError("No registry for lookup")
|
RuntimeError: No registry for lookup
|