Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13502

Reprocess the 2 WIDE tracts of RC2 with w_2018_03

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Process WIDE_VVDS (tract=9697) and WIDE_GAMA15H (tract=9615) data with w_2018_03
      and add the output products to the repo of DM-13463. Pipeline steps and configs are the same as DM-13463.

      The visit IDs are as defined in DM-11345 this comment

        Attachments

          Issue Links

            Activity

            Hide
            sthrush Samantha Thrush added a comment -

            makeSkyMap.py ran without any warnings or errors.  While trying to run singleFrameDriver, I noticed that I was getting a lot of OSErrors, stating "No space left on device".  I'm currently waiting for some files to be cleared out of /project/ before trying to run the script again.  

            Show
            sthrush Samantha Thrush added a comment - makeSkyMap.py ran without any warnings or errors.  While trying to run singleFrameDriver, I noticed that I was getting a lot of OSErrors, stating "No space left on device".  I'm currently waiting for some files to be cleared out of /project/ before trying to run the script again.  
            Hide
            sthrush Samantha Thrush added a comment - - edited

            After running singleFrameDriver again, I was able to get the jobs to end successfully, with only 5 FATAL errors.  The errors were as follows:

            Wide_VVDS, Filter G: {'visit': 34412, 'ccd': 78}, {'visit': 34448, 'ccd': 23}

            • 2 errors: RuntimeError: Unable to match sources.

            Wide_VVDS, Filter I: {'visit': 35892, 'ccd': 12}, {'visit': 36118, 'ccd': 21}, {'visit': 36216, 'ccd': 6}

            • 3 errors: RuntimeError: No matches to use for photocal. 

            Most of these visits match up with the fatal errors found by DM-11345, with the exception that DM-11345 found an error for {visit: 34414, ccd: 70} in filter G of Wide_VVDS, whereas I found an error for {visit: 34448, ccd: 23} in the Wide_VVDS G filter. 

            Show
            sthrush Samantha Thrush added a comment - - edited After running singleFrameDriver again, I was able to get the jobs to end successfully, with only 5 FATAL errors.  The errors were as follows: Wide_VVDS, Filter G: {'visit': 34412, 'ccd': 78}, {'visit': 34448, 'ccd': 23} 2 errors: RuntimeError: Unable to match sources. Wide_VVDS, Filter I: {'visit': 35892, 'ccd': 12}, {'visit': 36118, 'ccd': 21}, {'visit': 36216, 'ccd': 6} 3 errors: RuntimeError: No matches to use for photocal.  Most of these visits match up with the fatal errors found by DM-11345 , with the exception that DM-11345 found an error for {visit: 34414, ccd: 70} in filter G of Wide_VVDS, whereas I found an error for {visit: 34448, ccd: 23} in the Wide_VVDS G filter. 
            Hide
            sthrush Samantha Thrush added a comment -

            mosaic.py ran without any warnings or errors for both data sets and all bands.  

            Show
            sthrush Samantha Thrush added a comment - mosaic.py ran without any warnings or errors for both data sets and all bands.  
            Hide
            sthrush Samantha Thrush added a comment -

            coaddDriver.py ran without any FATAL errors, however, as seen in DM-11345, there were quite a few Warnings about "Removing visits". All of these warnings were because the visit and ccd had a median e residual that was too large or their scaled size scatter was too large. A list of all of the occurances of "Removing visits" (found by using grep) is shown below.

            coadd visit list & filter number of "Removing visits" found
             WIDE_GAMA15H, G  14
             WIDE_GAMA15H, R 134
             WIDE_GAMA15H, I 45
            WIDE_GAMA15H, Z 4
             WIDE_GAMA15H, Y 14
            WIDE_VVDS, G 20
            WIDE_VVDS, R 26
            WIDE_VVDS, I 562
            WIDE_VVDS, Z 43
            WIDE_VVDS, Y 135

            While these results are similar to those found within DM-11345, the numbers do not match up exactly.  

            Show
            sthrush Samantha Thrush added a comment - coaddDriver.py ran without any FATAL errors, however, as seen in DM-11345 , there were quite a few Warnings about "Removing visits". All of these warnings were because the visit and ccd had a median e residual that was too large or their scaled size scatter was too large. A list of all of the occurances of "Removing visits" (found by using grep) is shown below. coadd visit list & filter number of "Removing visits" found  WIDE_GAMA15H, G  14  WIDE_GAMA15H, R 134  WIDE_GAMA15H, I 45 WIDE_GAMA15H, Z 4  WIDE_GAMA15H, Y 14 WIDE_VVDS, G 20 WIDE_VVDS, R 26 WIDE_VVDS, I 562 WIDE_VVDS, Z 43 WIDE_VVDS, Y 135 While these results are similar to those found within DM-11345 , the numbers do not match up exactly.  
            Hide
            sthrush Samantha Thrush added a comment -

            Both multiBandDriver.py code runs finished successfully and without any FATAL errors. However, I did get 5 warnings from multiBandDriver.measureCoaddSources when I ran multiBandDriver on the VVDS data set:

            Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-G', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended
            Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-R', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended
            Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-I', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended
            Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-Z', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended
            Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-Y', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended

            Show
            sthrush Samantha Thrush added a comment - Both multiBandDriver.py code runs finished successfully and without any FATAL errors. However, I did get 5 warnings from multiBandDriver.measureCoaddSources when I ran multiBandDriver on the VVDS data set: Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-G', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-R', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-I', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-Z', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended Patch DataId(initialdata={'tract': 9697, 'filter': 'HSC-Y', 'patch': '7,0'}, tag=set()) contains 1 large footprints that were not deblended
            Hide
            sthrush Samantha Thrush added a comment -

            The run-times, and node-hours used for each of the jobs is detailed below.  The total node hours used is 116.3681.

            Code Visit set, filter Time Elapsed JobID Nodes Node-Hours
             makeSkyMap.py   00:01:20 108743 1 0.0222
            singleFrameDriver.py WIDE_GAMA15H, G  00:58:11 108763 3 2.9091
              WIDE_GAMA15H, R 01:09:08 108764 3 3.4566
              WIDE_GAMA15H, I 01:42:41 108765 3 5.1342
              WIDE_GAMA15H, Z 01:15:22 108766 3 3.7683
              WIDE_GAMA15H, Y 01:20:15 108767 3 4.0125
              WIDE_VVDS, G 01:08:54 108768 3 3.4449
              WIDE_VVDS, R 01:16:37 108769 3 3.8307
              WIDE_VVDS, I 02:22:44 108770 3 7.1367
              WIDE_VVDS, Z 01:33:11 108771 3 4.6593
              WIDE_VVDS, Y 01:35:55 108772 3 4.7958
            mosaic.py WIDE_GAMA15H, G 00:14:19 108793 1 0.2386
              WIDE_GAMA15H, R 00:16:30 108794 1 0.275
              WIDE_GAMA15H, I 00:27:23 108795 1 0.4564
              WIDE_GAMA15H, Z 00:24:06 108796 1 0.4017
              WIDE_GAMA15H, Y 00:22:27 108797 1 0.3742
              WIDE_VVDS, G 00:16:08 108798 1 0.2689
              WIDE_VVDS, R 00:18:36 108799 1 0.31
              WIDE_VVDS, I 00:33:27 108800 1 0.5575
              WIDE_VVDS, Z 00:29:50 108802 1 0.4972
              WIDE_VVDS, Y 00:28:16 108801 1 0.4711
            coaddDriver.py WIDE_GAMA15H, G 01:19:07 108808 1 1.3186
              WIDE_GAMA15H, R 01:14:35 108809 1 1.2431
              WIDE_GAMA15H, I 01:53:55 108810 1 1.8986
              WIDE_GAMA15H, Z 01:53:57 108811 1 1.8992
              WIDE_GAMA15H, Y 01:53:14 108812 1 1.8872
              WIDE_VVDS, G 01:29:36 108813 1 1.4933
              WIDE_VVDS, R 01:30:02 108814 1 1.5006
              WIDE_VVDS, I 01:55:04 108815 1 1.9178
              WIDE_VVDS, Z 02:10:43 108816 1 2.1786
              WIDE_VVDS, Y 01:11:57 108817 1 1.1992
            multiBandDriver.py GAMA15H 02:22:58 108905 10 23.828
              VVDS 02:53:54 108906 10 28.983
            Show
            sthrush Samantha Thrush added a comment - The run-times, and node-hours used for each of the jobs is detailed below.  The total node hours used is 116.3681. Code Visit set, filter Time Elapsed JobID Nodes Node-Hours  makeSkyMap.py   00:01:20 108743 1 0.0222 singleFrameDriver.py WIDE_GAMA15H, G  00:58:11 108763 3 2.9091   WIDE_GAMA15H, R 01:09:08 108764 3 3.4566   WIDE_GAMA15H, I 01:42:41 108765 3 5.1342   WIDE_GAMA15H, Z 01:15:22 108766 3 3.7683   WIDE_GAMA15H, Y 01:20:15 108767 3 4.0125   WIDE_VVDS, G 01:08:54 108768 3 3.4449   WIDE_VVDS, R 01:16:37 108769 3 3.8307   WIDE_VVDS, I 02:22:44 108770 3 7.1367   WIDE_VVDS, Z 01:33:11 108771 3 4.6593   WIDE_VVDS, Y 01:35:55 108772 3 4.7958 mosaic.py WIDE_GAMA15H, G 00:14:19 108793 1 0.2386   WIDE_GAMA15H, R 00:16:30 108794 1 0.275   WIDE_GAMA15H, I 00:27:23 108795 1 0.4564   WIDE_GAMA15H, Z 00:24:06 108796 1 0.4017   WIDE_GAMA15H, Y 00:22:27 108797 1 0.3742   WIDE_VVDS, G 00:16:08 108798 1 0.2689   WIDE_VVDS, R 00:18:36 108799 1 0.31   WIDE_VVDS, I 00:33:27 108800 1 0.5575   WIDE_VVDS, Z 00:29:50 108802 1 0.4972   WIDE_VVDS, Y 00:28:16 108801 1 0.4711 coaddDriver.py WIDE_GAMA15H, G 01:19:07 108808 1 1.3186   WIDE_GAMA15H, R 01:14:35 108809 1 1.2431   WIDE_GAMA15H, I 01:53:55 108810 1 1.8986   WIDE_GAMA15H, Z 01:53:57 108811 1 1.8992   WIDE_GAMA15H, Y 01:53:14 108812 1 1.8872   WIDE_VVDS, G 01:29:36 108813 1 1.4933   WIDE_VVDS, R 01:30:02 108814 1 1.5006   WIDE_VVDS, I 01:55:04 108815 1 1.9178   WIDE_VVDS, Z 02:10:43 108816 1 2.1786   WIDE_VVDS, Y 01:11:57 108817 1 1.1992 multiBandDriver.py GAMA15H 02:22:58 108905 10 23.828   VVDS 02:53:54 108906 10 28.983
            Hide
            sthrush Samantha Thrush added a comment -

            I ran wc -l to find calexp files in the deepCoadd-results directory to see if there were any missing patches, and all 5 filters for both tracts (9615, and 9697) had all 81 patches present. Additionally, all 81 patches were present in /deepCoadd-results/merged/ for both tracts discussed here. These results mirror those found in DM-11345.

            Show
            sthrush Samantha Thrush added a comment - I ran wc -l to find calexp files in the deepCoadd-results directory to see if there were any missing patches, and all 5 filters for both tracts (9615, and 9697) had all 81 patches present. Additionally, all 81 patches were present in /deepCoadd-results/merged/ for both tracts discussed here. These results mirror those found in DM-11345 .

              People

              Assignee:
              sthrush Samantha Thrush
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang, Samantha Thrush
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.