Details
-
Type:
Improvement
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: ap_verify
-
Labels:None
-
Story Points:2
-
Epic Link:
-
Sprint:AP S22-6 (May)
-
Team:Alert Production
Description
The Gen 3 preloaded/ repository currently contains curated calibs, as a side effect of its creation using Gen 2->3 conversion. However, preloading curated calibs increases the size of the download, causes unnecessary repository churn, and causes potential conflicts with template skymaps (possibly fixed upstream). Investigate whether curated calibs can be left out of the downloaded dataset, and picked up from <obs>_data during ingestion instead.
This issue cannot be done while we are maintaining datasets using Gen 2->3 conversion, as the dataset ingestion code must assume either that curated calibs are present or that they are absent.
Attachments
Issue Links
- is blocked by
-
DM-28628 Actually adopt new calibs in ap_verify HiTS datasets
- In Progress
-
DM-29857 Create pure Gen 3 dataset management scripts for ap_verify datasets
- Done
- mitigates
-
DM-25414 Guard against re-ingestion of curated calibs in ap_verify
- Invalid
- relates to
-
DM-33039 Re-examine how to handle dataset management scripts
- Done
Running butler write-curated-calibrations for DECam takes about 2 minutes, so the trade-off is non-trivial.