Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14357

Gather metadata entries from the LDF environment in dispatch_verify.py

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: verify
    • Labels:
      None

      Description

      As discussed in DM-14328 we need to specify a new environment in lsst.verify called LDF from which we will gather the following variables and add them as metadata to the verification job.

      - ``DATASET``: the name of the dataset processed, e.g 'HSC RC2'
      - ``DATASET_REPO_URL``: a reference URL with information about the dataset
      - ``RUN_ID``: ID of the run in the LDF environment
      - ``RUN_ID_URL``: a reference URL with information about the run
      - ``VERSION_TAG``: the version tag of the LSST software used, e.g. 'w_2018_18'
      

        Attachments

          Issue Links

            Activity

            Hide
            afausti Angelo Fausti added a comment - - edited

            Example of command to test the LDF environment:

            export DATASET="HSC RC2"
            export DATASET_REPO_URL="https://jira.lsstcorp.org/browse/DM-11345"
            export RUN_ID="DM-10084"
            export RUN_ID_URL="https://jira.lsstcorp.org/browse/DM-10084"
            export STACK_VERSION="w_2018_18"
            

            Run the command without uploading to SQuaSH:

            dispatch_verify.py --test --env ldf --ignore-lsstsw --show test_job.json 
            

            Run the command uploading to the SQuaSH demo instance:

            dispatch_verify.py --url https://squash-restful-api-demo.lsst.codes --user <squash user> --password <squash passwd> --env ldf --ignore-lsstsw test_job.json 
            

            Show
            afausti Angelo Fausti added a comment - - edited Example of command to test the LDF environment: export DATASET="HSC RC2" export DATASET_REPO_URL="https://jira.lsstcorp.org/browse/DM-11345" export RUN_ID="DM-10084" export RUN_ID_URL="https://jira.lsstcorp.org/browse/DM-10084" export STACK_VERSION="w_2018_18" Run the command without uploading to SQuaSH: dispatch_verify.py --test --env ldf --ignore-lsstsw --show test_job.json Run the command uploading to the SQuaSH demo instance: dispatch_verify.py --url https://squash-restful-api-demo.lsst.codes --user <squash user> --password <squash passwd> --env ldf --ignore-lsstsw test_job.json
            Hide
            afausti Angelo Fausti added a comment -
            Show
            afausti Angelo Fausti added a comment - See PR: https://github.com/lsst/verify/pull/25
            Hide
            jsick Jonathan Sick added a comment -

            Looks great. I put a couple suggestions on the PR.

            Show
            jsick Jonathan Sick added a comment - Looks great. I put a couple suggestions on the PR.
            Hide
            afausti Angelo Fausti added a comment -

            Thank you Jonathan Sick for reviewing this.

            Show
            afausti Angelo Fausti added a comment - Thank you Jonathan Sick for reviewing this.
            Hide
            afausti Angelo Fausti added a comment -

            Merged.

            Show
            afausti Angelo Fausti added a comment - Merged.

              People

              • Assignee:
                afausti Angelo Fausti
                Reporter:
                afausti Angelo Fausti
                Reviewers:
                Jonathan Sick
                Watchers:
                Angelo Fausti, Jonathan Sick
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel