Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15859

Run pipe_analysis and validate_drp with w_2018_38 HSC RC2 outputs

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • None
    • None

    Description

      Run pipe_analysis scripts

      1. visitAnalysis
      2. coaddAnalysis
      3. colorAnalysis
      4. compareVisitAnalysis
      5. compareCoaddAnalysis

      and validate_drp

      1. matchedVisitMetrics.py
      2. validateDrp.py
      3. reportPerformance.py

      Upload the validate_drp metrics (json files) to SQuaSH:

      1. dispatch_verify.py

      with the w_2018_38 RC2 outputs from DM-15690

      Attachments

        Issue Links

          Activity

            With w_2018_38, matchedVisitMetrics.py, validateDrp.py and reportPerformance.py were run with SFM and mosaic results. filter=NB0921 is ignored for validateDrp.py due to DM-15127.

            validate_drp results and logs are at
            /datasets/hsc/repo/rerun/RC/w_2018_38/DM-15690/validateDrp/
            and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/

            hchiang2 Hsin-Fang Chiang added a comment - With w_2018_38 , matchedVisitMetrics.py , validateDrp.py and reportPerformance.py were run with SFM and mosaic results. filter=NB0921 is ignored for validateDrp.py due to DM-15127 . validate_drp results and logs are at /datasets/hsc/repo/rerun/RC/w_2018_38/ DM-15690 /validateDrp/ and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/

            pipe_analysis has been broken as reported in DM-15869 

            hchiang2 Hsin-Fang Chiang added a comment - pipe_analysis has been broken as reported in DM-15869  

            The fix is out.  For the pipe_analysis runs, use w_2018_41 + pipe_analysis branch tickets/DM-15569 (at commit f39be9d) + meas_mosaic branch tickets/DM-15916 (at commit c2a3a41).

            hchiang2 Hsin-Fang Chiang added a comment - The fix is out.  For the pipe_analysis runs, use  w_2018_41 + pipe_analysis branch tickets/ DM-15569 (at commit f39be9d ) + meas_mosaic branch tickets/ DM-15916 (at commit c2a3a41 ).

            The pipe_analysis comparison scripts are run against the rerun of RC/w_2018_36/DM-15603

            hchiang2 Hsin-Fang Chiang added a comment - The  pipe_analysis comparison scripts are run against the rerun of RC/w_2018_36/ DM-15603

            pipe_analysis logs are at
            /datasets/hsc/repo/rerun/RC/w_2018_38/DM-15690/qaLogs/
            They can also be accessed via
            https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_38/

            hchiang2 Hsin-Fang Chiang added a comment - pipe_analysis logs are at /datasets/hsc/repo/rerun/RC/w_2018_38/ DM-15690 /qaLogs/ They can also be accessed via https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_38/

            coaddAnalysis failed with tract=9615 filter=HSC-R; DM-16363 has been filed.

            hchiang2 Hsin-Fang Chiang added a comment - coaddAnalysis failed with tract=9615 filter=HSC-R; DM-16363 has been filed.

            People

              hchiang2 Hsin-Fang Chiang
              hchiang2 Hsin-Fang Chiang
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.