Details
-
Type:
Story
-
Status: Won't Fix
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Team:Data Access and Database
Description
While working with w_2018_06 and experimenting with skyCorrection.py (https://community.lsst.org/t/hsc-defaults-now-require-sky-correction/2631), I noticed something that was unexpected. In the community documentation above, the --calib argument seems to be required in order to run the command. However, when I run such a command:
skyCorrection.py /datasets/hsc/repo --calib /datasets/hsc/repo/CALIB --rerun private/thrush/RG --job skyCgamaG --time 60 --cores 112 --batch-type slurm --mpiexec='-bind-to socket' --id visit=$wide_gama15hG |
I receive the following Traceback:
Traceback (most recent call last):
|
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/pipe_drivers/6.0b0-hsc-16-geaac007+2/bin/skyCorrection.py", line 3, in <module> |
SkyCorrectionTask.parseAndSubmit()
|
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/ctrl_pool/14.0-1-ga2912ff+30/python/lsst/ctrl/pool/parallel.py", line 424, in parseAndSubmit |
**kwargs) |
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/ctrl_pool/14.0-1-ga2912ff+30/python/lsst/ctrl/pool/parallel.py", line 333, in parse_args |
args.parent = self._parent.parse_args(config, args=leftover, **kwargs) |
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/pipe_base/14.0-6-ge2c9487+39/python/lsst/pipe/base/argumentParser.py", line 614, in parse_args |
namespace.butler = dafPersist.Butler(inputs=inputs, outputs=outputs) |
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/daf_persistence/14.0-14-g87d16e8+10/python/lsst/daf/persistence/butler.py", line 521, in __init__ |
self._getCfgs(repoDataList) |
File "/software/lsstsw/stack3_20171023/stack/miniconda3-4.3.21-10a4fa6/Linux64/daf_persistence/14.0-14-g87d16e8+10/python/lsst/daf/persistence/butler.py", line 821, in _getCfgs |
cfg, repoData.repoArgs))
|
RuntimeError: The RepositoryArgs and RepositoryCfg must match for writable repositories, RepositoryCfg:RepositoryCfg(root='/datasets/hsc/repo/rerun/private/thrush/RG', mapper=<class 'lsst.obs.hsc.hscMapper.HscMapper'>, mapperArgs={}, parents=[RepositoryCfg(root='/datasets/hsc/repo', mapper=<class 'lsst.obs.hsc.hscMapper.HscMapper'>, mapperArgs={}, parents=[], policy=None)], policy=None), RepositoryArgs:RepositoryArgs(root='/datasets/hsc/repo/rerun/private/thrush/RG', cfgRoot=None, mapper=None, mapperArgs={'calibRoot': '/datasets/hsc/repo/CALIB'}, tags=set(), mode='rw', policy=None) |
However, when I run the following code (lacking the --calib), it runs perfectly:
skyCorrection.py /datasets/hsc/repo --rerun private/thrush/RG --job skyCgamaG --time 60 --cores 112 --batch-type slurm --mpiexec='-bind-to socket' --id visit=$wide_gama15hG |
It should be noted that when I ran singleFrameDriver.py in order to prepare for running skyCorrection.py, I did not specify --calib. I am fairly certain that this error is related to DM-11333.
Attachments
Issue Links
Activity
Passing or not passing the calib repo path inconsistently when chaining reruns was a frequent problem in Gen2. But we don't care anymore.
I assume we can close this as won't fix given that gen3 exists and gen2 is deprecated. cc/ Jim Bosch. (I'm not sure why this ticket was assigned to the gen2 butler team).