Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14357

Gather metadata entries from the LDF environment in dispatch_verify.py

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: verify
    • Labels:
      None

      Description

      As discussed in DM-14328 we need to specify a new environment in lsst.verify called LDF from which we will gather the following variables and add them as metadata to the verification job.

      - ``DATASET``: the name of the dataset processed, e.g 'HSC RC2'
      		 
      - ``DATASET_REPO_URL``: a reference URL with information about the dataset
      		 
      - ``RUN_ID``: ID of the run in the LDF environment
      		 
      - ``RUN_ID_URL``: a reference URL with information about the run
      		 
      - ``VERSION_TAG``: the version tag of the LSST software used, e.g. 'w_2018_18'

        Attachments

          Issue Links

          is child task of

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-14328 Publish verification jobs produced by the HSC reprocessing to SQuaSH

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            afausti Angelo Fausti added a comment - - edited

            Example of command to test the LDF environment:

            export DATASET="HSC RC2"
            		 
            export DATASET_REPO_URL="https://jira.lsstcorp.org/browse/DM-11345"
            		 
            export RUN_ID="DM-10084"
            		 
            export RUN_ID_URL="https://jira.lsstcorp.org/browse/DM-10084"
            		 
            export STACK_VERSION="w_2018_18"

            Run the command without uploading to SQuaSH:

            dispatch_verify.py --test --env ldf --ignore-lsstsw --show test_job.json

            Run the command uploading to the SQuaSH demo instance:

            dispatch_verify.py --url https://squash-restful-api-demo.lsst.codes --user <squash user> --password <squash passwd> --env ldf --ignore-lsstsw test_job.json

            Show
            afausti Angelo Fausti added a comment - - edited Example of command to test the LDF environment: export DATASET="HSC RC2" export DATASET_REPO_URL="https://jira.lsstcorp.org/browse/DM-11345" export RUN_ID="DM-10084" export RUN_ID_URL="https://jira.lsstcorp.org/browse/DM-10084" export STACK_VERSION="w_2018_18" Run the command without uploading to SQuaSH: dispatch_verify.py --test --env ldf --ignore-lsstsw --show test_job.json Run the command uploading to the SQuaSH demo instance: dispatch_verify.py --url https://squash-restful-api-demo.lsst.codes --user <squash user> --password <squash passwd> --env ldf --ignore-lsstsw test_job.json
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            See PR: https://github.com/lsst/verify/pull/25

            Show
            afausti Angelo Fausti added a comment - See PR: https://github.com/lsst/verify/pull/25
            Hide
            Permalink
            jsick Jonathan Sick added a comment -

            Looks great. I put a couple suggestions on the PR.

            Show
            jsick Jonathan Sick added a comment - Looks great. I put a couple suggestions on the PR.
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Thank you Jonathan Sick for reviewing this.

            Show
            afausti Angelo Fausti added a comment - Thank you Jonathan Sick for reviewing this.
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Merged.

            Show
            afausti Angelo Fausti added a comment - Merged.

              People

              Assignee:
              afausti Angelo Fausti
              Reporter:
              afausti Angelo Fausti
              Reviewers:
              Jonathan Sick
              Watchers:
              Angelo Fausti, Jonathan Sick
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.