Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16055

Run pipe_analysis and validate_drp with w_2018_41 HSC RC2 outputs

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Run pipe_analysis scripts

      1. visitAnalysis
      2. coaddAnalysis
      3. colorAnalysis
      4. compareVisitAnalysis
      5. compareCoaddAnalysis

      and validate_drp

      1. matchedVisitMetrics.py
      2. validateDrp.py
      3. reportPerformance.py

      Upload the validate_drp metrics (json files) to SQuaSH:

      1. dispatch_verify.py

      with the w_2018_41 RC2 outputs from DM-16011

        Attachments

          Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. DM-15869 Fix for renaming *_flux to *_instFlux

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-16011 Reprocess RC2 with w_2018_41

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            With w_2018_41, matchedVisitMetrics.py, validateDrp.py and reportPerformance.py were run with SFM and mosaic results. filter=NB0921 is ignored for validateDrp.py due to DM-15127.

            validate_drp results and logs are at
            /datasets/hsc/repo/rerun/RC/w_2018_41/DM-16011/validateDrp/
            and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/

            Show
            hchiang2 Hsin-Fang Chiang added a comment - With w_2018_41 , matchedVisitMetrics.py , validateDrp.py and reportPerformance.py were run with SFM and mosaic results. filter=NB0921 is ignored for validateDrp.py due to DM-15127 . validate_drp results and logs are at /datasets/hsc/repo/rerun/RC/w_2018_41/ DM-16011 /validateDrp/ and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            pipe_analysis is broken as reported in DM-15869 

            Show
            hchiang2 Hsin-Fang Chiang added a comment - pipe_analysis is broken as reported in DM-15869  
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            The fix is out. For the pipe_analysis runs, use w_2018_41 + pipe_analysis branch tickets/DM-15569 (at commit f39be9d) + meas_mosaic branch tickets/DM-15916 (at commit c2a3a41).

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The fix is out. For the pipe_analysis runs, use  w_2018_41 + pipe_analysis branch tickets/ DM-15569 (at commit f39be9d ) + meas_mosaic branch tickets/ DM-15916 (at commit c2a3a41 ).
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            The pipe_analysis comparison scripts are run against the rerun of RC/w_2018_38/DM-15690 (DM-15859)

            Show
            hchiang2 Hsin-Fang Chiang added a comment - The  pipe_analysis comparison scripts are run against the rerun of RC/w_2018_38/ DM-15690 ( DM-15859 )
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            pipe_analysis logs are at
            /datasets/hsc/repo/rerun/RC/w_2018_41/DM-16011/qaLogs/
            They can also be accessed via
            https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_41/

            Show
            hchiang2 Hsin-Fang Chiang added a comment - pipe_analysis logs are at /datasets/hsc/repo/rerun/RC/w_2018_41/ DM-16011 /qaLogs/ They can also be accessed via https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_41/
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            coaddAnalysis failed with tract=9615 filter=HSC-R; DM-16363 has been filed.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - coaddAnalysis failed with tract=9615 filter=HSC-R; DM-16363 has been filed.

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.