# Add a script to summarize what visits are in what patches

XMLWordPrintable

## Details

• Type: Story
• Status: Done
• Resolution: Done
• Fix Version/s: None
• Component/s: None
• Labels:
None
• Story Points:
5
• Team:
Data Facility

## Description

(Actual assignee: Samuel Piehl)

Have a script to show what visits are in what tracts/patches. This is especially useful for running coadd making and processing (e.g. makeCoaddTempExp, assembleCoadd) with runOrca and HTCondor, as the dataId of the jobs need to be specified. So this script's output will be in the format of a runOrca input file.

## Activity

Hide
Hsin-Fang Chiang added a comment -

Sam has started to work on this and the script outputs two files - a condensed and an expanded orca input file; the expanded writes one line for each filter in each patch (e.g. filter=i tract=0 patch=8,1 --selectId visit=232735), and can be used for commands such as makeCoaddTempExp.py and assembleCoadd.py. The condensed one outputs one line for each patch (e.g. filter=i^z tract=0 patch=8,1), and can be used for commands such as detectCoaddSources.py and mergeCoaddSources.py.

Show
Hsin-Fang Chiang added a comment - Sam has started to work on this and the script outputs two files - a condensed and an expanded orca input file; the expanded writes one line for each filter in each patch (e.g. filter=i tract=0 patch=8,1 --selectId visit=232735), and can be used for commands such as makeCoaddTempExp.py and assembleCoadd.py. The condensed one outputs one line for each patch (e.g. filter=i^z tract=0 patch=8,1), and can be used for commands such as detectCoaddSources.py and mergeCoaddSources.py.
Hide
Hsin-Fang Chiang added a comment -

Colin Slater may you please review this ticket? Sam is the actual author but I'll pass messages around for him.

Show
Hsin-Fang Chiang added a comment - Colin Slater may you please review this ticket? Sam is the actual author but I'll pass messages around for him.
Hide
Hsin-Fang Chiang added a comment - - edited

(from Sam)
Here's an example of how to run it:

 python /path_to_skymap/skymap/examples/summarizePatches.py path_ro_repo --ccdKey ccdnum --saveOverview --saveSummaries patches.input 

where path_ro_repo is the root directory of a data repository (for example /home/sspiehl/test_runs/test3/rerun/orca1/ if you want to test-run it). This would save 3 files: patchesOverview, expanded_patches.input, and condensed_patches.input. You can specify which visits to use by passing --visits 0230069 (for example).

Show
Hsin-Fang Chiang added a comment - - edited (from Sam) Here's an example of how to run it: python /path_to_skymap/skymap/examples/summarizePatches.py path_ro_repo --ccdKey ccdnum --saveOverview --saveSummaries patches.input where path_ro_repo is the root directory of a data repository (for example /home/sspiehl/test_runs/test3/rerun/orca1/ if you want to test-run it). This would save 3 files: patchesOverview, expanded_patches.input, and condensed_patches.input. You can specify which visits to use by passing --visits 0230069 (for example).
Hide
Colin Slater added a comment -

This is a good script to have. I put a few stylistic comments in the pull request, otherwise good to go.

Show
Colin Slater added a comment - This is a good script to have. I put a few stylistic comments in the pull request, otherwise good to go.
Hide
Hsin-Fang Chiang added a comment -

Thank you Colin for reviewing.

Based on the comments on the PR Sam's script is not merged to the master, but will be kept as it's useful before a better solution becomes available (e.g. DM-5766, or fixing reportImagesInPatch.py/reportImagesToCoadd.py in pipe_tasks, etc). I'm closing this ticket.

Show
Hsin-Fang Chiang added a comment - Thank you Colin for reviewing. Based on the comments on the PR Sam's script is not merged to the master, but will be kept as it's useful before a better solution becomes available (e.g. DM-5766 , or fixing reportImagesInPatch.py/reportImagesToCoadd.py in pipe_tasks, etc). I'm closing this ticket.

## People

• Assignee:
Hsin-Fang Chiang
Reporter:
Hsin-Fang Chiang
Reviewers:
Colin Slater
Watchers:
Colin Slater, Hsin-Fang Chiang