Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: pipe_tasks
-
Labels:None
-
Story Points:6
-
Epic Link:
-
Sprint:Science Pipelines DM-W16-3, Science Pipelines DM-W16-4
-
Team:Data Release Production
Description
A script for performing pipeline output QA is under development for HSC. The script provides many useful tools for plotting and analyzing pipeline outputs on single visits and coadds. This is of general use for LSST and, in particular, will be adapted/expanded to include tools for the direct comparisons of identical data sets processed with both the HSC and LSST pipelines (i.e. DM-2984). Appropriate adaptations for this script to run with the LSST stack will be made here (with the understanding that development is still ongoing on HSC and further adaptations will be accommodated as necessary/desired).
See HSC-1320 and HSC-1359 for details and examples of the output of this script.
Attachments
Issue Links
- blocks
-
DM-2984 Compare LSST and HSC pipelines through ISR
- Done
- relates to
-
DM-4730 Adapt qa analysis script for LSST vs. HSC single visit processing comparison
- Done
-
DM-4731 Add labels to qa analysis plots for better interpretation
- Done
-
DM-6588 Adapt qa analysis script for LSST vs. HSC coadd processing comparison
- Done
-
DM-6647 Adapt qa analysis script to apply corrections measured by meas_mosaic
- Done
-
DM-9381 Add ability to highlight data subsets in analysis plots
- Done
Thanks for all those clarifications. A few thoughts in response:
Since you're not planning to merge any of the analysis script to master at the moment, this isn't necessary. When merges to master do happen, they should obviously only contain finished & reviewed code, so if you did want to push the single visit analysis in before the coadd stuff was ready there'd be an issue... but you don't, so no problem.
I don't think this is necessary, except insofar as Paul thinks your changes would be useful on the HSC side, so long as Robert is happy that your output is sane and will constitute a useful comparison between the HSC and LSST stacks.
I've not had time to seriously attempt to read or understand the analysis task, but just grepping for "hsc" produces a lot of results. For example here and here.
We're really under time pressure to finish the HSC merge. I'd rather see this work complete on HSC so we can declare the merge done, and worry about portability to other instrumentation later – don't spend any time on making this generic for now, but do feel free to file tickets describing what ought to be done in future.
Given all that ... what would you actually like me to do in terms of a review here? It sounds like the changes you've made to afw will go in as a separate ticket, which I'll stand ready to review when it appears; meanwhile there's no code which we expect to merge to the stack from this ticket, and Robert has volunteered to sanity check it. Is there anything I can add to that?