Details
-
Type:
Bug
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: ap_verify
-
Labels:None
-
Story Points:1
-
Epic Link:
-
Sprint:AP F20-1 (June)
-
Team:Alert Production
-
Urgent?:No
Description
Following the merge of DM-23983, ap_verify crashes because it only ingests defects, and not other types of curated calibrations (in particular, crosstalk coefficients). Modify ap.verify.ingestion.DatasetIngestTask to process 0 or more curated calibrations in the format expected by IngestCuratedCalibsTask.
In addition to updating the (obs_lsst, obs_decam, obs_subaru) package override files for DatasetIngestConfig, double-check that this field is not overridden in the four existing datasets.
Since this will break all configs for DatasetIngestTask anyway, also rename textDefectPath and defectIngester to curatedCalibPaths and curatedCalibIngester, respectively.
Attachments
Issue Links
Activity
Thanks for addressing this promptly! Just minor GitHub comments. (I think I found all the PRs, Jira was a little slow to discover them, let me know if I missed one.)
Please do run ap_verify on at least the CI-sized datasets to ensure it works now. We should keep an eye on this for whenever DM-25348 is merged and inter-CCD crosstalk is implemented in Gen 3.
Thanks for the quick review! I've already tested both of the CI datasets and they both work.
Krzysztof Findeisen
added a comment - Thanks for the quick review! I've already tested both of the CI datasets and they both work. 
I ended up not needing to make any changes to obs_lsst (it doesn't have a config file yet), and DECam is the only instrument that actually has the new crosstalk files at the moment. Changes are otherwise as in the issue description.