Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: obs_base
-
Labels:
-
Epic Link:
-
Team:Data Facility
-
Urgent?:No
Description
The conversion was originally attempted with w_2020_40, but it failed. A schema was renamed from rc2w38_ssw40 to rc2w38_ssw42, and another attempt was made with the w_2020_42 stack.
Attachments
Issue Links
- mentioned in
-
Page Loading...
Activity
I have a potential fix on branch u/jbosch/DM-27113 of obs_base. Monika Adamow, could you test that? If it works, we should make sure it gets through Jenkins ci_hsc before merging it.
Jim Bosch one problem fixed, another popped out.
INFO 2020-10-22T16:29:42.040-0500 convertRepo - Calibration validity gap closed from 2017-09-04 00:00:00.000 to 2017-09-05 00:00:00.000
|
Traceback (most recent call last):
|
File "./gen3-hsc-rc2/bootstrap.py", line 356, in <module>
|
main()
|
File "./gen3-hsc-rc2/bootstrap.py", line 352, in main
|
continue_=options.continue_, reruns=reruns)
|
File "./gen3-hsc-rc2/bootstrap.py", line 302, in run
|
visits=makeVisitList(tracts, filters)
|
File "/scratch/madamow/rc2w38_convert_w42/obs_base/python/lsst/obs/base/gen2to3/convertRepo.py", line 583, in run
|
chain.append(spec.parent)
|
AttributeError: 'Rerun' object has no attribute 'parent'
|
Monika Adamow
added a comment - Jim Bosch one problem fixed, another popped out.
INFO 2020-10-22T16:29:42.040-0500 convertRepo - Calibration validity gap closed from 2017-09-04 00:00:00.000 to 2017-09-05 00:00:00.000
Traceback (most recent call last):
File "./gen3-hsc-rc2/bootstrap.py", line 356, in <module>
main()
File "./gen3-hsc-rc2/bootstrap.py", line 352, in main
continue_=options.continue_, reruns=reruns)
File "./gen3-hsc-rc2/bootstrap.py", line 302, in run
visits=makeVisitList(tracts, filters)
File "/scratch/madamow/rc2w38_convert_w42/obs_base/python/lsst/obs/base/gen2to3/convertRepo.py", line 583, in run
chain.append(spec.parent)
AttributeError: 'Rerun' object has no attribute 'parent'
I've pushed another commit to the u/jbosch/DM-27113 branch of obs_base that will hopefully fix that one.
Thanks Jim Bosch! The conversion is complete.
Monika Adamow
added a comment - Thanks Jim Bosch ! The conversion is complete. 
I have a theory: there are equivalent deepCoadd_skyMap datasets in multiple Gen2 repos, we have no code dedicating to deduplicating them, and a
config.runs["deepCoadd_skyMap"]
override is telling the converter to put them all in one Gen3 collection. I think we want some of those to land in rerun-named collections instead, which means that override is active somewhere it shouldn't be in the converter code. But I'd like to poke around the Gen2 repos and conversion code to test that theory to be sure.