Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11980

Reprocess RC with w_2017_40

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Reprocess the HSC RC dataset, as defined in DMTR-31 Sect. 4.1 , using Stack w_2017_40. Steps include makeSkyMap.py, singleFrameDriver.py, mosaic.py, coaddDriver.py, and multiBandDriver.py (DM-10129/DM-11020).

        Attachments

          Issue Links

            Activity

            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            SingleFrameDriver/prcessCcd failed in 12 CCDs at WIDE, and 17 CCDs at COSMOS. Their data IDs are:

            --id visit=278 ccd=95 --id visit=280 ccd=22 --id visit=280 ccd=69 --id visit=284 ccd=61 --id visit=28376 ccd=69 --id visit=28382 ccd=101 --id visit=28392 ccd=101 --id visit=28396 ccd=102 --id visit=28398 ccd=95 --id visit=28398 ccd=101 --id visit=28400 ccd=5 --id visit=28400 ccd=53 --id visit=28400 ccd=61 --id visit=28400 ccd=95 --id visit=28400 ccd=100 --id visit=28400 ccd=101 --id visit=28400 ccd=102 --id visit=9868 ccd=76 --id visit=9868 ccd=77 --id visit=11582 ccd=76 --id visit=7344 ccd=67 --id visit=19468 ccd=69 --id visit=6478 ccd=99 --id visit=6528 ccd=24 --id visit=6528 ccd=59 --id visit=6528 ccd=67 --id visit=9736 ccd=67 --id visit=17738 ccd=69 --id visit=17750 ccd=58
            

            Out of the 29 singleFrameDriver/prcessCcd fatal failures:

            • 14 failed with "Unable to match sources"
            • 4 failed with "No objects passed our cuts for consideration as psf stars"
            • 11 failed with "PSF star selector found [123] candidates"

            Compared to the run with w_2017_38 in DM-11979, the following data have different pass/fail outcome:
            passed in w_2017_38 but failed now
            visit=9868 ccd=77
            visit=6528 ccd=59

            failed in w_2017_38 but passed now
            visit=28392 ccd=102
            visit=28394 ccd=93

            The differences seem related to DM-9579, and it has been reported in DM-12179.

            A log with the 29 processCcd failures is attached:log_w40_retryFailedSfm.txt

            Show
            hchiang2 Hsin-Fang Chiang added a comment - SingleFrameDriver/prcessCcd failed in 12 CCDs at WIDE, and 17 CCDs at COSMOS. Their data IDs are: --id visit= 278 ccd= 95 --id visit= 280 ccd= 22 --id visit= 280 ccd= 69 --id visit= 284 ccd= 61 --id visit= 28376 ccd= 69 --id visit= 28382 ccd= 101 --id visit= 28392 ccd= 101 --id visit= 28396 ccd= 102 --id visit= 28398 ccd= 95 --id visit= 28398 ccd= 101 --id visit= 28400 ccd= 5 --id visit= 28400 ccd= 53 --id visit= 28400 ccd= 61 --id visit= 28400 ccd= 95 --id visit= 28400 ccd= 100 --id visit= 28400 ccd= 101 --id visit= 28400 ccd= 102 --id visit= 9868 ccd= 76 --id visit= 9868 ccd= 77 --id visit= 11582 ccd= 76 --id visit= 7344 ccd= 67 --id visit= 19468 ccd= 69 --id visit= 6478 ccd= 99 --id visit= 6528 ccd= 24 --id visit= 6528 ccd= 59 --id visit= 6528 ccd= 67 --id visit= 9736 ccd= 67 --id visit= 17738 ccd= 69 --id visit= 17750 ccd= 58 Out of the 29 singleFrameDriver/prcessCcd fatal failures: 14 failed with "Unable to match sources" 4 failed with "No objects passed our cuts for consideration as psf stars" 11 failed with "PSF star selector found [123] candidates" Compared to the run with w_2017_38 in DM-11979 , the following data have different pass/fail outcome: passed in w_2017_38 but failed now visit=9868 ccd=77 visit=6528 ccd=59 failed in w_2017_38 but passed now visit=28392 ccd=102 visit=28394 ccd=93 The differences seem related to DM-9579 , and it has been reported in DM-12179 . A log with the 29 processCcd failures is attached: log_w40_retryFailedSfm.txt
            Hide
            hchiang2 Hsin-Fang Chiang added a comment -

            The numbers of coadd/multiband products and the empty patches are the same as w_2017_28 (DM-11184 , this comment). No fatal errors were seen in the logs; many warnings as before.

            The output repo is available at /datasets/hsc/repo/rerun/RC/w_2017_40/DM-11980/

            Logs have been copied to /datasets/hsc/repo/rerun/RC/w_2017_40/DM-11980/logs/

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The numbers of coadd/multiband products and the empty patches are the same as w_2017_28 ( DM-11184 , this comment ). No fatal errors were seen in the logs; many warnings as before. The output repo is available at /datasets/hsc/repo/rerun/RC/w_2017_40/ DM-11980 / Logs have been copied to /datasets/hsc/repo/rerun/RC/w_2017_40/ DM-11980 /logs/

              People

              • Assignee:
                hchiang2 Hsin-Fang Chiang
                Reporter:
                hchiang2 Hsin-Fang Chiang
                Watchers:
                Hsin-Fang Chiang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel