Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12545

Reprocess RC with w_2017_46

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Reprocess the HSC RC dataset, as defined in DMTR-31 Sect. 4.1 , using Stack w_2017_46. Steps include makeSkyMap.py, singleFrameDriver.py, mosaic.py, coaddDriver.py, and multiBandDriver.py (DM-10129/DM-11020).

        Attachments

          Issue Links

            Activity

            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            SingleFrameDriver/prcessCcd failed in 12 CCDs at WIDE, and 20 CCDs at COSMOS. Their data IDs are:

            --id visit=278 ccd=95 --id visit=280 ccd=22 --id visit=280 ccd=69 --id visit=280 ccd=103 --id visit=284 ccd=61 --id visit=11698 ccd=68 --id visit=17934 ccd=1 --id visit=23596 ccd=6 --id visit=23600 ccd=1 --id visit=28376 ccd=69 --id visit=28382 ccd=101 --id visit=28392 ccd=101 --id visit=28396 ccd=102 --id visit=28398 ccd=95 --id visit=28398 ccd=101 --id visit=28400 ccd=53 --id visit=28400 ccd=61 --id visit=28400 ccd=95 --id visit=28400 ccd=100 --id visit=28400 ccd=101 --id visit=9868 ccd=76 --id visit=11582 ccd=76 --id visit=7344 ccd=67 --id visit=19468 ccd=69 --id visit=6478 ccd=99 --id visit=6528 ccd=24 --id visit=6528 ccd=59 --id visit=6528 ccd=67 --id visit=9708 ccd=99 --id visit=9736 ccd=67 --id visit=17738 ccd=69 --id visit=17750 ccd=58
            

            Out of the 32 singleFrameDriver/prcessCcd fatal failures:

            • 5 failed with "Unable to match sources"
            • 4 failed with "No objects passed our cuts for consideration as psf stars"
            • 5 failed with "RuntimeError: No matches to use for photocal"
            • 18 failed with "PSF star selector found [123] candidates"

            A log with the 32 processCcd failures is attached: log_w46_retryFailedSfm-102553.out

            Show
            hchiang2 Hsin-Fang Chiang added a comment - SingleFrameDriver/prcessCcd failed in 12 CCDs at WIDE, and 20 CCDs at COSMOS. Their data IDs are: --id visit= 278 ccd= 95 --id visit= 280 ccd= 22 --id visit= 280 ccd= 69 --id visit= 280 ccd= 103 --id visit= 284 ccd= 61 --id visit= 11698 ccd= 68 --id visit= 17934 ccd= 1 --id visit= 23596 ccd= 6 --id visit= 23600 ccd= 1 --id visit= 28376 ccd= 69 --id visit= 28382 ccd= 101 --id visit= 28392 ccd= 101 --id visit= 28396 ccd= 102 --id visit= 28398 ccd= 95 --id visit= 28398 ccd= 101 --id visit= 28400 ccd= 53 --id visit= 28400 ccd= 61 --id visit= 28400 ccd= 95 --id visit= 28400 ccd= 100 --id visit= 28400 ccd= 101 --id visit= 9868 ccd= 76 --id visit= 11582 ccd= 76 --id visit= 7344 ccd= 67 --id visit= 19468 ccd= 69 --id visit= 6478 ccd= 99 --id visit= 6528 ccd= 24 --id visit= 6528 ccd= 59 --id visit= 6528 ccd= 67 --id visit= 9708 ccd= 99 --id visit= 9736 ccd= 67 --id visit= 17738 ccd= 69 --id visit= 17750 ccd= 58 Out of the 32 singleFrameDriver/prcessCcd fatal failures: 5 failed with "Unable to match sources" 4 failed with "No objects passed our cuts for consideration as psf stars" 5 failed with "RuntimeError: No matches to use for photocal" 18 failed with "PSF star selector found [123] candidates" A log with the 32 processCcd failures is attached: log_w46_retryFailedSfm-102553.out
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            These passed with w_2017_44 but failed with w_2017_46

             --id visit=280 ccd=103
             --id visit=11698 ccd=68
             --id visit=17934 ccd=1
             --id visit=23596 ccd=6
             --id visit=23600 ccd=1
             --id visit=9708 ccd=99
            

            These failed with w_2017_44 but passed with w_2017_46

             --id visit=28400 ccd=5
             --id visit=28400 ccd=102
             --id visit=9868 ccd=77
            

            This may be related to DM-12207

            Show
            hchiang2 Hsin-Fang Chiang added a comment - These passed with w_2017_44 but failed with w_2017_46 --id visit= 280 ccd= 103 --id visit= 11698 ccd= 68 --id visit= 17934 ccd= 1 --id visit= 23596 ccd= 6 --id visit= 23600 ccd= 1 --id visit= 9708 ccd= 99 These failed with w_2017_44 but passed with w_2017_46 --id visit= 28400 ccd= 5 --id visit= 28400 ccd= 102 --id visit= 9868 ccd= 77 This may be related to DM-12207
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            coaddDriver was run with the ticket branch of DM-12766, because otherwise it only worked with 1 core and would take 10-20 times longer.

            In COSMOS tract 9813, the coadd products deepCoadd_calexp/deepCoadd_calexp_background/deepCoadd_det and deepCoadd_meas/deepCoadd_forced_src have 78 patches in HSC-G, 79 in HSC-I, 74 in HSC-R, 79 in HSC-Y, 79 in HSC-Z, and 75 in NB0921; in total 464 patches. The empty patches of tract 9813 are:

            • patch 0,0 HSC-G,HSC-I,HSC-R,HSC-Y,HSC-Z,NB0921
            • patch 0,8 HSC-G,HSC-I,HSC-R,HSC-Y,HSC-Z,NB0921
            • patch 0,1 HSC-R,HSC-G,NB0921
            • patch 0,7 HSC-R,NB0921
            • patch 1,8 HSC-R,NB0921
            • patch 8,0 HSC-G,HSC-R
            • patch 8,8 HSC-R,NB0921

            The results are different from w_2017_44/DM-12388 (highlighted above). In the NB0921 band, the number of warps that "could not be created" (directWarp/psfMatchedWarp "has 0 good pixels") is higher compared to w_2017_44, leading to the one additional empty coadd patch at 0,1. The numbers of warps that could not be created are also different in other bands.

            Products deepCoadd_measMatch and deepCoadd_measMatchFull have 461 patches in total in tract 9813; this is 3 fewer than other products as it missed all 6 bands in patch 0,1. The following message appeared in the log for HSC-I, HSC-Z, and HSC-Y bands:

            multiBandDriver.measureCoaddSources.match: Matched 0 from 290/290 input and 7220/7220 reference sources 
            

            In WIDE, both tract 8766 and 8767 have all 81 patches of coadd products in all 5 bands.

            The MultiBand products deepCoadd_mergeDet and deepCoadd_ref have 81 patches in WIDE tracts 8766 and 8767, 79 patches in COSMOS tract 9813.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - coaddDriver was run with the ticket branch of DM-12766 , because otherwise it only worked with 1 core and would take 10-20 times longer. In COSMOS tract 9813, the coadd products deepCoadd_calexp/deepCoadd_calexp_background/deepCoadd_det and deepCoadd_meas/deepCoadd_forced_src have 78 patches in HSC-G, 79 in HSC-I, 74 in HSC-R, 79 in HSC-Y, 79 in HSC-Z, and 75 in NB0921; in total 464 patches. The empty patches of tract 9813 are: patch 0,0 HSC-G,HSC-I,HSC-R,HSC-Y,HSC-Z,NB0921 patch 0,8 HSC-G,HSC-I,HSC-R,HSC-Y,HSC-Z,NB0921 patch 0,1 HSC-R, HSC-G,NB0921 patch 0,7 HSC-R,NB0921 patch 1,8 HSC-R,NB0921 patch 8,0 HSC-G ,HSC-R patch 8,8 HSC-R,NB0921 The results are different from w_2017_44/ DM-12388 (highlighted above). In the NB0921 band, the number of warps that "could not be created" (directWarp/psfMatchedWarp "has 0 good pixels") is higher compared to w_2017_44, leading to the one additional empty coadd patch at 0,1. The numbers of warps that could not be created are also different in other bands. Products deepCoadd_measMatch and deepCoadd_measMatchFull have 461 patches in total in tract 9813; this is 3 fewer than other products as it missed all 6 bands in patch 0,1. The following message appeared in the log for HSC-I, HSC-Z, and HSC-Y bands: multiBandDriver.measureCoaddSources.match: Matched 0 from 290 / 290 input and 7220 / 7220 reference sources In WIDE, both tract 8766 and 8767 have all 81 patches of coadd products in all 5 bands. The MultiBand products deepCoadd_mergeDet and deepCoadd_ref have 81 patches in WIDE tracts 8766 and 8767, 79 patches in COSMOS tract 9813.
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            The output repo is available at /datasets/hsc/repo/rerun/RC/w_2017_46/DM-12545/

            Logs have been copied to /datasets/hsc/repo/rerun/RC/w_2017_46/DM-12545/logs/

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The output repo is available at /datasets/hsc/repo/rerun/RC/w_2017_46/ DM-12545 / Logs have been copied to /datasets/hsc/repo/rerun/RC/w_2017_46/ DM-12545 /logs/
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            The total size of the output repo is significantly smaller than before (~5.2TB in w_2017_46, compared to ~8TB in w_2017_44); this seems expected by RFC-378/DM-12599.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The total size of the output repo is significantly smaller than before (~5.2TB in w_2017_46, compared to ~8TB in w_2017_44); this seems expected by RFC-378 / DM-12599 .
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            A meas_mosaic bug affecting coadd products of this weekly is identified and fixed in DM-12882

            Show
            hchiang2 Hsin-Fang Chiang added a comment - A meas_mosaic bug affecting coadd products of this weekly is identified and fixed in DM-12882

              People

              • Assignee:
                hchiang2 Hsin-Fang Chiang
                Reporter:
                hchiang2 Hsin-Fang Chiang
                Watchers:
                Hsin-Fang Chiang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: