Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15690

Reprocess RC2 with w_2018_38

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Reprocess the HSC RC2 dataset, as defined in DM-11345, using Stack w_2018_38. Steps include makeSkyMap.py, singleFrameDriver.py, mosaic.py, skyCorrection.py, coaddDriver.py, and multiBandDriver.py. 

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15837 mosaic.py error "Field with name 'i_fluxErr' not found"

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15856 Run jointcal with HSC-RC2 and w_2018_38

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15859 Run pipe_analysis and validate_drp with w_2018_38 HSC RC2 outputs

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            In singleFrameDriver, among the 432 visits of the RC2 dataset, 10 CCDs failed, same data IDs as w_2018_32/DM-15184 (this comment).

            Show
            hchiang2 Hsin-Fang Chiang added a comment - In singleFrameDriver, among the 432 visits of the RC2 dataset, 10 CCDs failed, same data IDs as w_2018_32/ DM-15184 ( this comment ).
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            w_2018_38 mosaic.py failed with errors like "Field with name 'i_fluxErr' not found" and seg fault, as reported in DM-15837. 

             
            Using the tickets/DM-15837 branch at commit  736553c, the runs were able to finish.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - w_2018_38 mosaic.py failed with errors like "Field with name 'i_fluxErr' not found" and seg fault, as reported in  DM-15837 .    Using the  tickets/ DM-15837 branch at commit  736553c , the runs were able to finish.
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            jointcal failed with w_2018_38: see DM-15856 and DM-15857.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - jointcal failed with w_2018_38 : see DM-15856 and DM-15857 .
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Using the mosaic results with the DM-15837 ticket branch, continued coadd/multiband with w_2018_38.

            The number of coadd/multiband data products and empty patches are the same as w_2018_15/DM-14123 (this comment)

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Using the mosaic results with the DM-15837 ticket branch, continued coadd/multiband with w_2018_38 . The number of coadd/multiband data products and empty patches are the same as w_2018_15/ DM-14123 ( this comment )
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            The output repo is at /datasets/hsc/repo/rerun/RC/w_2018_38/DM-15690/
            The logs have been copied to /datasets/hsc/repo/rerun/RC/w_2018_38/DM-15690/logs/
            The pipe_analysis and validate_drp runs are at DM-15859; the jointcal run is at DM-15856 (both waiting for fixes at this moment)

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The output repo is at /datasets/hsc/repo/rerun/RC/w_2018_38/ DM-15690 / The logs have been copied to /datasets/hsc/repo/rerun/RC/w_2018_38/ DM-15690 /logs/ The pipe_analysis and validate_drp runs are at DM-15859 ; the jointcal run is at DM-15856 (both waiting for fixes at this moment)

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.