This is not completely finished - I still need to work on pipelines_check and ci_cpp - but it's close enough that I think it's time to get the review started. It's also big enough that I'm going to try to split up the review. I expect all of the "recreate the Gen3 repo" packages to be recreated at least one more time (after
DM-26738 lands and I rebase on that), but I don't think any of the scripts that do that work will need further updating.
Most of the review, including some extra functionality in daf_butler and a lot of curated-calibration stuff in obs packages and CI. Packages:
Changes to PipelineTask utilities to support calibration datasets in connections and resolved lookups in ButlerQuantumContext. And some temporary code in GraphBuilder to do the calibration lookups themselves - this is neither as fast nor as clean as it will be after
DM-26692; it should be slightly faster but is also less clean than what came before. Package:
Updates to the ap_verify repos. I have changes for ap_verify itself and what I think are complete changes for ap_verify_testdata, but have not looked at other packages. The changes driven by this ticket are unfortunately mixed up with some related to
DM-26138, which broke Gen2 imSim repos in a way that was only reliably noticeable if one then proceeded to create a Gen3 repo from the Gen2 repo (and this ticket was the first to do that for ap_verify_testdata since that change). Packages:
ISR and CPP, but probably not useful to get started yet; I'll ping you again when it's time.
- TBD PRs for cp_pipe and ci_cpp.