Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32059

Keep example tasks from executing in default faro pipelines

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • faro

    Description

      When executing metrics_pipeline_jointcal_fgcm.yaml (for example), metrics such as AM1_info, nsrcMeasTract, nsrcMeas, agg_summary_AB1, agg_sum_nsrc, agg_sum_nsrcVisit are calculated. These metrics exist for pedagogical/demonstration purposes, but need not be calculated in regular faro runs. Move them to separate pipeline(s).

      Attachments

        Issue Links

          Activity

            I will create new pipelines that can be used for testing/debugging/examples. The full pipelines will be called metrics_pipeline_test_example.yaml and metrics_pipeline_jointcal_fgcm_test_example.yaml. These will in turn import pipelines that execute a subset of available metrics along with the demo metrics.

            jcarlin Jeffrey Carlin added a comment - I will create new pipelines that can be used for testing/debugging/examples. The full pipelines will be called metrics_pipeline_test_example.yaml and metrics_pipeline_jointcal_fgcm_test_example.yaml. These will in turn import pipelines that execute a subset of available metrics along with the demo metrics.
            jcarlin Jeffrey Carlin added a comment - - edited

            I've confirmed that all of these jobs execute successfully on `rc2_subset`:

            $FARO_DIR/pipelines/metrics_pipeline.yaml

            $FARO_DIR/pipelines/metrics_pipeline_jointcal_fgcm.yaml

            $FARO_DIR/pipelines/example/metrics_pipeline_test_example.yaml

            $FARO_DIR/pipelines/example/metrics_pipeline_jointcal_fgcm_test_example.yaml

            Jenkins job is at: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/35135/pipeline

             

            jcarlin Jeffrey Carlin added a comment - - edited I've confirmed that all of these jobs execute successfully on `rc2_subset`: $FARO_DIR/pipelines/metrics_pipeline.yaml $FARO_DIR/pipelines/metrics_pipeline_jointcal_fgcm.yaml $FARO_DIR/pipelines/example/metrics_pipeline_test_example.yaml $FARO_DIR/pipelines/example/metrics_pipeline_jointcal_fgcm_test_example.yaml Jenkins job is at: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/35135/pipeline  

            I have also confirmed that this fixes the issue with `ci_hsc_gen3` and `obs_subaru` (see DM-32058; DM-32029 is the ticket with ongoing obs_subaru and ci_hsc changes).

            jcarlin Jeffrey Carlin added a comment - I have also confirmed that this fixes the issue with `ci_hsc_gen3` and `obs_subaru` (see DM-32058 ; DM-32029 is the ticket with ongoing obs_subaru and ci_hsc changes).

            PR is here.

            jcarlin Jeffrey Carlin added a comment - PR is here .

            People

              jcarlin Jeffrey Carlin
              jcarlin Jeffrey Carlin
              Simon Krughoff (Inactive)
              Jeffrey Carlin, Leanne Guy, Simon Krughoff (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.