Data ManagementIcon indicating the project type

Data Management

Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-15742

Write shell script to serve as a Jenkins hook

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_verify
    • Labels:
      None
    • Story Points:
      6
    • Epic Link:
    • Sprint:
      AP F18-4
    • Team:
      Alert Production

      Description

      As proposed in DM-13970, ap_verify should have a script that handles interaction between Jenkins (which should only need to know dataset names) and ap_verify itself. We should be able to model our script on validate_drp's solution, although the standardized nature of ap_verify datasets may simplify the implementation.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15983 Create a Jenkins job for ap_verify

          • Done
          has to be done after

          Improvement - An improvement or enhancement to an existing feature or task. DM-15142 Create CI-sized DECam Dataset

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-13970 Investigate options for integrating AP with CI

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            krzys Krzysztof Findeisen added a comment -

            Hi Joshua Hoblitt, can you take a look at the script and see if it suits your needs? The script takes only one argument, the name of the dataset to be processed, and produces a number of metrics .json files as output.

            On my laptop, a run of run_ci_dataset.sh -d CI-HiTS2015 takes just under 8 minutes. This is without parallelism. The six metrics .json files take up 1.1 MiB combined; note that these files have somewhat awkward names (e.g., ap_verify.visit=411371 ccdnum=56 filter=g.verify.json).

            Show
            krzys Krzysztof Findeisen added a comment - Hi Joshua Hoblitt , can you take a look at the script and see if it suits your needs? The script takes only one argument, the name of the dataset to be processed, and produces a number of metrics .json files as output. On my laptop, a run of run_ci_dataset.sh -d CI-HiTS2015 takes just under 8 minutes. This is without parallelism. The six metrics .json files take up 1.1 MiB combined; note that these files have somewhat awkward names (e.g., ap_verify.visit=411371 ccdnum=56 filter=g.verify.json ).
            Hide
            Permalink
            jhoblitt Joshua Hoblitt added a comment -

            PR approved on github.

            Show
            jhoblitt Joshua Hoblitt added a comment - PR approved on github.

              People

              • Assignee:
                krzys Krzysztof Findeisen
                Reporter:
                krzys Krzysztof Findeisen
                Reviewers:
                Joshua Hoblitt
                Watchers:
                Joshua Hoblitt, Krzysztof Findeisen, Simon Krughoff
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel