Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21888

Stand up Gen3 version of ap_verify HiTS (2015) CI test

    Details

    • Story Points:
      3
    • Team:
      Alert Production

      Description

      This is an umbrella ticket for getting all current Gen2 ap_verify CI functionality working in Gen3.  It includes (at least):

      • defining a Pipeline that includes (and reconfigures as necessary) (DM-21919):
        • the former ApPipeTask, which will be a pipeline rather than a Task in Gen 3 (DM-21939)
        • Many concrete MetricTasks (DM-21885)
      • creating scripts that ingest HiTS test data into a Gen3 repository (DM-21862).
      • creating scripts that upload metric values from a Gen 3 repository (DM-21916).
      • validation that the Gen3 version of the CI package produces results that are either scientifically equivalent or both understandably and acceptably different from the Gen2 version (no separate ticket, yet).

        Attachments

          Issue Links

            Activity

            Hide
            krzys Krzysztof Findeisen added a comment -

            I think I've enumerated everything we need to run ap_verify on the existing datasets in Gen 3. Jim Bosch, am I correct in assuming that the 4 SP on this ticket are reserved for the "validation" ticket you mentioned?

            Show
            krzys Krzysztof Findeisen added a comment - I think I've enumerated everything we need to run ap_verify on the existing datasets in Gen 3. Jim Bosch , am I correct in assuming that the 4 SP on this ticket are reserved for the "validation" ticket you mentioned?
            Hide
            jbosch Jim Bosch added a comment -

            Yes, that and the integration work ("write and commit a pipeline YAML file") to put it all together.

            Show
            jbosch Jim Bosch added a comment - Yes, that and the integration work ("write and commit a pipeline YAML file") to put it all together.
            Hide
            krzys Krzysztof Findeisen added a comment - - edited

            Hmm... well, DM-21919 naturally covers that for metrics.

            Should we split off another umbrella ticket for "make ap_pipe runnable from the command line as a Gen 3 pipeline"? That would block DM-21919 and be itself blocked by DM-21862, DM-21874, DM-21886, and possibly DM-21915 (ap_verify datasets are often used to create ap_pipe test repositories, even though it's not their intended use).

            Show
            krzys Krzysztof Findeisen added a comment - - edited Hmm... well, DM-21919 naturally covers that for metrics. Should we split off another umbrella ticket for "make ap_pipe runnable from the command line as a Gen 3 pipeline"? That would block DM-21919 and be itself blocked by DM-21862 , DM-21874 , DM-21886 , and possibly DM-21915 ( ap_verify datasets are often used to create ap_pipe test repositories, even though it's not their intended use).
            Hide
            jbosch Jim Bosch added a comment -

            Should we split off another umbrella ticket for "make ap_pipe runnable from the command line as a Gen 3 pipeline"?

            .  I'm more than happy for you to organize this in whatever way works best for you; at this point I think your idea of what needs to be done here is pretty complete, in addition to just being better than mine.

            Show
            jbosch Jim Bosch added a comment - Should we split off another umbrella ticket for "make ap_pipe runnable from the command line as a Gen 3 pipeline"? .  I'm more than happy for you to organize this in whatever way works best for you; at this point I think your idea of what needs to be done here is pretty complete, in addition to just being better than mine.

              People

              • Assignee:
                Unassigned
                Reporter:
                jbosch Jim Bosch
                Watchers:
                Ian Sullivan, Jim Bosch, Krzysztof Findeisen
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel