Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6991

Add a script to summarize what visits are in what patches

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      (Actual assignee: Samuel Piehl)

      Have a script to show what visits are in what tracts/patches. This is especially useful for running coadd making and processing (e.g. makeCoaddTempExp, assembleCoadd) with runOrca and HTCondor, as the dataId of the jobs need to be specified. So this script's output will be in the format of a runOrca input file.

        Attachments

          Issue Links

            Activity

            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Sam has started to work on this and the script outputs two files - a condensed and an expanded orca input file; the expanded writes one line for each filter in each patch (e.g. filter=i tract=0 patch=8,1 --selectId visit=232735), and can be used for commands such as makeCoaddTempExp.py and assembleCoadd.py. The condensed one outputs one line for each patch (e.g. filter=i^z tract=0 patch=8,1), and can be used for commands such as detectCoaddSources.py and mergeCoaddSources.py.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Sam has started to work on this and the script outputs two files - a condensed and an expanded orca input file; the expanded writes one line for each filter in each patch (e.g. filter=i tract=0 patch=8,1 --selectId visit=232735), and can be used for commands such as makeCoaddTempExp.py and assembleCoadd.py. The condensed one outputs one line for each patch (e.g. filter=i^z tract=0 patch=8,1), and can be used for commands such as detectCoaddSources.py and mergeCoaddSources.py.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Colin Slater may you please review this ticket? Sam is the actual author but I'll pass messages around for him.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Colin Slater may you please review this ticket? Sam is the actual author but I'll pass messages around for him.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment - - edited

            (from Sam)
            Here's an example of how to run it:

            python /path_to_skymap/skymap/examples/summarizePatches.py  path_ro_repo --ccdKey ccdnum --saveOverview --saveSummaries patches.input
            

            where path_ro_repo is the root directory of a data repository (for example /home/sspiehl/test_runs/test3/rerun/orca1/ if you want to test-run it). This would save 3 files: patchesOverview, expanded_patches.input, and condensed_patches.input. You can specify which visits to use by passing --visits 0230069 (for example).

            Show
            hchiang2 Hsin-Fang Chiang added a comment - - edited (from Sam) Here's an example of how to run it: python /path_to_skymap/skymap/examples/summarizePatches.py path_ro_repo --ccdKey ccdnum --saveOverview --saveSummaries patches.input where path_ro_repo is the root directory of a data repository (for example /home/sspiehl/test_runs/test3/rerun/orca1/ if you want to test-run it). This would save 3 files: patchesOverview, expanded_patches.input, and condensed_patches.input. You can specify which visits to use by passing --visits 0230069 (for example).
            Hide
            ctslater Colin Slater added a comment -

            This is a good script to have. I put a few stylistic comments in the pull request, otherwise good to go.

            Show
            ctslater Colin Slater added a comment - This is a good script to have. I put a few stylistic comments in the pull request, otherwise good to go.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            Thank you Colin for reviewing.

            Based on the comments on the PR Sam's script is not merged to the master, but will be kept as it's useful before a better solution becomes available (e.g. DM-5766, or fixing reportImagesInPatch.py/reportImagesToCoadd.py in pipe_tasks, etc). I'm closing this ticket.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Thank you Colin for reviewing. Based on the comments on the PR Sam's script is not merged to the master, but will be kept as it's useful before a better solution becomes available (e.g. DM-5766 , or fixing reportImagesInPatch.py/reportImagesToCoadd.py in pipe_tasks, etc). I'm closing this ticket.

              People

              • Assignee:
                hchiang2 Hsin-Fang Chiang
                Reporter:
                hchiang2 Hsin-Fang Chiang
                Reviewers:
                Colin Slater
                Watchers:
                Colin Slater, Hsin-Fang Chiang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel