Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34237

Remove ap_verify dataset Gen 2 config files

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_verify
    • Labels:
      None
    • Story Points:
      1
    • Sprint:
      AP S22-4 (March), AP S22-5 (April)
    • Team:
      Alert Production
    • Urgent?:
      No

      Description

      DM-33150 removed Gen 2 support from ap_verify; for the datasets, this entailed backing the dataset contents with a Gen 3 repository rather than uningested files, but (for stability) no other changes.

      The ap_verify datasets have historically kept their dataset-specific configuration in Python config files, to ensure that the same configs are being used in Gen 2 and Gen 3. However, this arrangement has prevented use of some Gen 3 features (in particular, pipeline parameters) that let us centralize config information, which in turn has meant frequent updates to the ap_verify dataset configs for changes made to the ApVerify or ApPipe pipelines themselves.

      Now that we only need to support Gen 3, there is no benefit to keeping the config files around. Merge all config information into the pipelines that use them, maximizing use of parameters.

        Attachments

          Issue Links

            Activity

            Hide
            krzys Krzysztof Findeisen added a comment -

            Thanks for agreeing to review this, Meredith Rawls!

            Show
            krzys Krzysztof Findeisen added a comment - Thanks for agreeing to review this, Meredith Rawls !
            Hide
            sullivan Ian Sullivan added a comment -

            These changes look good, thank you!

            Show
            sullivan Ian Sullivan added a comment - These changes look good, thank you!

              People

              Assignee:
              krzys Krzysztof Findeisen
              Reporter:
              krzys Krzysztof Findeisen
              Reviewers:
              Ian Sullivan
              Watchers:
              Ian Sullivan, John Parejko, Krzysztof Findeisen, Meredith Rawls
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.