Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32694

Split AP pipeline into ApPipeWithFakes

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_pipe, ap_verify
    • Labels:
      None

      Description

      Currently, ApPipe.yaml is considered the "base" AP pipeline; it is included by ApVerify.yaml, which is in turn included by ApVerifyWithFakes.yaml. However, this design causes problems for ApVerifyWithFakes, which has a significantly different structure (in particular, a distinction between steps done with and without fakes) and its own rules for which metrics instrument which tasks.

      The problem can be mitigated by splitting ApPipe.yaml into two pipelines: one which is a dependency of ApVerify.yaml, and a new ApPipeWithFakes.yaml that is a dependency of ApVerifyWithFakes.yaml. ApPipe.yaml and ApPipeWithFakes.yaml will not depend on each other, allowing each to have the labels, contracts, and other elements that are appropriate for that pipeline.

      Configurations that should be shared between the two pipelines should be factored out into their own configs, consistent with RFC-775 guidelines.

        Attachments

          Issue Links

            Activity

            krzys Krzysztof Findeisen created issue -
            krzys Krzysztof Findeisen made changes -
            Field Original Value New Value
            Description Currently, {{ApPipe.yaml}} is considered the "base" AP pipeline; it is included by {{ApVerify.yaml}}, which is in turn included by {{ApVerifyWithFakes.yaml}}. However, this design causes problems for {{ApVerifyWithFakes}}, which has a significantly different structure (in particular, a distinction between steps done with and without fakes) and its own rules for which metrics instrument which tasks.

            The problem can be mitigated by splitting {{ApPipe.yaml}} into two pipelines: one which is a dependency of {{ApVerify.yaml}}, and a new {{ApPipeWithFakes.yaml}} that is a dependency of {{ApVerifyWithFakes.yaml}}. {{ApPipe.yaml}} and {{ApPipeWithFakes.yaml}} will not depend on each other, allowing each to have the labels, contracts, and other elements that are appropriate for that pipeline.
            Currently, {{ApPipe.yaml}} is considered the "base" AP pipeline; it is included by {{ApVerify.yaml}}, which is in turn included by {{ApVerifyWithFakes.yaml}}. However, this design causes problems for {{ApVerifyWithFakes}}, which has a significantly different structure (in particular, a distinction between steps done with and without fakes) and its own rules for which metrics instrument which tasks.

            The problem can be mitigated by splitting {{ApPipe.yaml}} into two pipelines: one which is a dependency of {{ApVerify.yaml}}, and a new {{ApPipeWithFakes.yaml}} that is a dependency of {{ApVerifyWithFakes.yaml}}. {{ApPipe.yaml}} and {{ApPipeWithFakes.yaml}} will not depend on each other, allowing each to have the labels, contracts, and other elements that are appropriate for that pipeline.

            Configurations that should be shared between the two pipelines should be factored out into their own configs, consistent with RFC-775 guidelines.
            krzys Krzysztof Findeisen made changes -
            Rank Ranked higher
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-32988 [ DM-32988 ]
            krzys Krzysztof Findeisen made changes -
            Rank Ranked higher
            sullivan Ian Sullivan made changes -
            Sprint AP S22-4 (March) [ 1148 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked higher
            sullivan Ian Sullivan made changes -
            Sprint AP S22-4 (March) [ 1148 ] AP S22-5 (April) [ 1156 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked lower
            sullivan Ian Sullivan made changes -
            Epic Link DM-30515 [ 510190 ] DM-30516 [ 510196 ]
            krzys Krzysztof Findeisen made changes -
            Rank Ranked higher
            krzys Krzysztof Findeisen made changes -
            Sprint AP S22-5 (April) [ 1156 ] AP S22-6 (May) [ 1161 ]
            krzys Krzysztof Findeisen made changes -
            Rank Ranked higher
            krzys Krzysztof Findeisen made changes -
            Sprint AP S22-6 (May) [ 1161 ] AP S22-5 (April) [ 1156 ]
            krzys Krzysztof Findeisen made changes -
            Rank Ranked lower
            krzys Krzysztof Findeisen made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            sullivan Ian Sullivan made changes -
            Story Points 4 8
            sullivan Ian Sullivan made changes -
            Sprint AP S22-5 (April) [ 1156 ] AP S22-6 (May) [ 1161 ]
            sullivan Ian Sullivan made changes -
            Rank Ranked higher
            krzys Krzysztof Findeisen made changes -
            Link This issue has to be done after DM-34254 [ DM-34254 ]
            krzys Krzysztof Findeisen made changes -
            Reviewers Meredith Rawls [ mrawls ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            mrawls Meredith Rawls made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            krzys Krzysztof Findeisen made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue duplicates DM-32726 [ DM-32726 ]
            sullivan Ian Sullivan made changes -
            Epic Link DM-30516 [ 510196 ] DM-34930 [ 1598461 ]

              People

              Assignee:
              krzys Krzysztof Findeisen
              Reporter:
              krzys Krzysztof Findeisen
              Reviewers:
              Meredith Rawls
              Watchers:
              Krzysztof Findeisen, Meredith Rawls
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.