Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-28182

Faro analysis of reprocessed RC2 data with w_2021_06

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: Verification
    • Labels:
      None

      Description

      Run faro on the RC2 reprocessed with w_2021_06. Compare results, in particular for the stellar locus metric with those from validate_drp and pipe_analysis.

       

      This was originally intended to be run on RC2 processing from w_2021_02, but `faro` was in the midst of a lot of changes at the time, so we will run this on w_2021_06 processing instead.

        Attachments

          Issue Links

            Activity

            Hide
            lguy Leanne Guy added a comment -

            This should be done with the first tagged version of faro

            Show
            lguy Leanne Guy added a comment - This should be done with the first tagged version of faro
            Hide
            jcarlin Jeffrey Carlin added a comment -

            Started matched visit metrics (i.e., only ones in single filters) as follows:

            time pipetask --long-log run -j 18 -b /project/hsc/gen3repo/rc2w02_ssw03/butler.yaml --register-dataset-types -p /project/jcarlin/test_pipetask/metric-pipeline-tasks/pipelines/metrics_pipeline_matched_externalCalibs.yaml -d "band in ('g', 'r', 'i') AND tract=9813 AND skymap='hsc_rings_v1' AND instrument='HSC'" -i HSC/runs/RC2/w_2021_02 --output u/jcarlin/faro_9813_matchedvisits_extcalib_gri 2>&1 | tee faro_tract9813_matchedvisits_log.txt

            Will add the multi-filter metrics afterwards.

            Show
            jcarlin Jeffrey Carlin added a comment - Started matched visit metrics (i.e., only ones in single filters) as follows: time pipetask --long-log run -j 18 -b /project/hsc/gen3repo/rc2w02_ssw03/butler.yaml --register-dataset-types -p /project/jcarlin/test_pipetask/metric-pipeline-tasks/pipelines/metrics_pipeline_matched_externalCalibs.yaml -d "band in ('g', 'r', 'i') AND tract=9813 AND skymap='hsc_rings_v1' AND instrument='HSC'" -i HSC/runs/RC2/w_2021_02 --output u/jcarlin/faro_9813_matchedvisits_extcalib_gri 2>&1 | tee faro_tract9813_matchedvisits_log.txt Will add the multi-filter metrics afterwards.
            Hide
            jcarlin Jeffrey Carlin added a comment -

            We did a lot of reorganization of `faro` around the time of that weekly release, so we will instead calculate metrics on the w_2021_06 weekly reprocessing of RC2. This will be the first `faro` run on RC2 since it became part of the shared/distributed stack.

            Show
            jcarlin Jeffrey Carlin added a comment - We did a lot of reorganization of `faro` around the time of that weekly release, so we will instead calculate metrics on the w_2021_06 weekly reprocessing of RC2. This will be the first `faro` run on RC2 since it became part of the shared/distributed stack.

              People

              Assignee:
              jcarlin Jeffrey Carlin
              Reporter:
              lguy Leanne Guy
              Reviewers:
              Leanne Guy
              Watchers:
              Jeffrey Carlin, Leanne Guy, Robert Lupton
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Due:
                Created:
                Updated:

                  CI Builds

                  No builds found.