Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32059

Keep example tasks from executing in default faro pipelines

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: faro
    • Labels:

      Description

      When executing metrics_pipeline_jointcal_fgcm.yaml (for example), metrics such as AM1_info, nsrcMeasTract, nsrcMeas, agg_summary_AB1, agg_sum_nsrc, agg_sum_nsrcVisit are calculated. These metrics exist for pedagogical/demonstration purposes, but need not be calculated in regular faro runs. Move them to separate pipeline(s).

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-32029 Add faro steps to DRP.yaml in obs_subaru

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            jcarlin Jeffrey Carlin added a comment -

            I will create new pipelines that can be used for testing/debugging/examples. The full pipelines will be called metrics_pipeline_test_example.yaml and metrics_pipeline_jointcal_fgcm_test_example.yaml. These will in turn import pipelines that execute a subset of available metrics along with the demo metrics.

            Show
            jcarlin Jeffrey Carlin added a comment - I will create new pipelines that can be used for testing/debugging/examples. The full pipelines will be called metrics_pipeline_test_example.yaml and metrics_pipeline_jointcal_fgcm_test_example.yaml. These will in turn import pipelines that execute a subset of available metrics along with the demo metrics.
            Hide
            Permalink
            jcarlin Jeffrey Carlin added a comment - - edited

            I've confirmed that all of these jobs execute successfully on `rc2_subset`:

            $FARO_DIR/pipelines/metrics_pipeline.yaml

            $FARO_DIR/pipelines/metrics_pipeline_jointcal_fgcm.yaml

            $FARO_DIR/pipelines/example/metrics_pipeline_test_example.yaml

            $FARO_DIR/pipelines/example/metrics_pipeline_jointcal_fgcm_test_example.yaml

            Jenkins job is at: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/35135/pipeline

             

            Show
            jcarlin Jeffrey Carlin added a comment - - edited I've confirmed that all of these jobs execute successfully on `rc2_subset`: $FARO_DIR/pipelines/metrics_pipeline.yaml $FARO_DIR/pipelines/metrics_pipeline_jointcal_fgcm.yaml $FARO_DIR/pipelines/example/metrics_pipeline_test_example.yaml $FARO_DIR/pipelines/example/metrics_pipeline_jointcal_fgcm_test_example.yaml Jenkins job is at: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/35135/pipeline  
            Hide
            Permalink
            jcarlin Jeffrey Carlin added a comment -

            I have also confirmed that this fixes the issue with `ci_hsc_gen3` and `obs_subaru` (see DM-32058; DM-32029 is the ticket with ongoing obs_subaru and ci_hsc changes).

            Show
            jcarlin Jeffrey Carlin added a comment - I have also confirmed that this fixes the issue with `ci_hsc_gen3` and `obs_subaru` (see DM-32058 ; DM-32029 is the ticket with ongoing obs_subaru and ci_hsc changes).
            Hide
            Permalink
            jcarlin Jeffrey Carlin added a comment -

            PR is here.

            Show
            jcarlin Jeffrey Carlin added a comment - PR is here .

              People

              Assignee:
              jcarlin Jeffrey Carlin
              Reporter:
              jcarlin Jeffrey Carlin
              Reviewers:
              Simon Krughoff
              Watchers:
              Jeffrey Carlin, Leanne Guy, Simon Krughoff
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.