Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15520

Run pipe_analysis and validate_drp with w_2018_34 HSC RC2 outputs

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Run pipe_analysis scripts

      1. visitAnalysis
      2. coaddAnalysis
      3. colorAnalysis
      4. compareVisitAnalysis
      5. compareCoaddAnalysis

      and validate_drp

      1. matchedVisitMetrics.py
      2. validateDrp.py
      3. reportPerformance.py

      Upload the validate_drp metrics (json files) to SQuaSH:

      1. dispatch_verify.py

      with the w_2018_34 RC2 outputs from DM-15517

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15109 Adapt pipe_analysis to RFC-498 implementation

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15517 Reprocess RC2 with w_2018_34

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Use w_2018_34 for validate_drp.

            Use the ticket branch of DM-15109 for pipe_analysis, branch tickets/DM-15109 at commit 3d3a7ad.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Use w_2018_34 for validate_drp . Use the ticket branch of DM-15109 for pipe_analysis , branch tickets/ DM-15109 at commit 3d3a7ad .
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            pipe_analysis branch tickets/DM-15109 at commit 3d3a7ad was used to run
            visitAnalysis compareVisitAnalysis coaddAnalysis and colorAnalysis.

            pipe_analysis branch tickets/DM-15109 at commit e006202 was used to run compareCoaddAnalysis.

            Both comparison scripts were done against w_2018_32/DM-15184.

            Show
            hchiang2 Hsin-Fang Chiang added a comment - pipe_analysis branch tickets/ DM-15109 at commit 3d3a7ad was used to run visitAnalysis compareVisitAnalysis coaddAnalysis and colorAnalysis . pipe_analysis branch tickets/ DM-15109 at commit e006202 was used to run compareCoaddAnalysis . Both comparison scripts were done against w_2018_32/ DM-15184 .
            Hide
            Permalink
            hchiang2 Hsin-Fang Chiang added a comment -

            Like before, filter=NB0921 is ignored for validateDrp.py due to DM-15127.

            validate_drp results and logs are at
            /datasets/hsc/repo/rerun/RC/w_2018_34/DM-15517/validateDrp/
            and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/

            pipe_analysis logs are at
            /datasets/hsc/repo/rerun/RC/w_2018_34/DM-15517/qaLogs/

            They can also be accessed via
            https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_34/

             

            Show
            hchiang2 Hsin-Fang Chiang added a comment - Like before, filter=NB0921 is ignored for validateDrp.py due to DM-15127 . validate_drp results and logs are at /datasets/hsc/repo/rerun/RC/w_2018_34/ DM-15517 /validateDrp/ and the results of all 6 filters in the COSMOS tract are uploaded to SQuaSH (dataset = HSC RC2) at https://squash.lsst.codes/ pipe_analysis logs are at /datasets/hsc/repo/rerun/RC/w_2018_34/ DM-15517 /qaLogs/ They can also be accessed via https://lsst-web.ncsa.illinois.edu/~hchiang2/RC2_w_2018_34/  

              People

              Assignee:
              hchiang2 Hsin-Fang Chiang
              Reporter:
              hchiang2 Hsin-Fang Chiang
              Watchers:
              Hsin-Fang Chiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.