Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21886

Create PipelineTask driver for ap_pipe tasks that interact with the APDB

    Details

    • Story Points:
      8
    • Sprint:
      AP F19-6 (November), AP S20-1 (December)
    • Team:
      Alert Production

      Description

      Create a PipelineTask whose runQuantum method includes all of the logic in ApPipeTask.runAssociation.

      This should probably be done after DM-21877, so it can use the same approach to signal completion of APDB writes to downstream PipelineTasks.

      It's not clear what to do about ownership of ApPipeTask.ppdb. It must belong to the new task in Gen 3, but doing so will break config overrides in Gen 2 (and the DB location is always overridden).

        Attachments

          Issue Links

            Activity

            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Link This issue is blocked by DM-21877 [ DM-21877 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-21862 [ DM-21862 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-21874 [ DM-21874 ]
            jbosch Jim Bosch made changes -
            Component/s ap_pipe [ 14281 ]
            Component/s ap_verify [ 14167 ]
            Component/s verify [ 15038 ]
            jbosch Jim Bosch made changes -
            Link This issue blocks DM-21888 [ DM-21888 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue has to be done before DM-21915 [ DM-21915 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21915 [ DM-21915 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue has to be done before DM-21915 [ DM-21915 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21919 [ DM-21919 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21915 [ DM-21915 ]
            krzys Krzysztof Findeisen made changes -
            Rank Ranked higher
            jbosch Jim Bosch made changes -
            Labels gen3-middleware gen2-deprecation-blocker gen3-middleware
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21939 [ DM-21939 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21919 [ DM-21919 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-21888 [ DM-21888 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue is blocked by DM-21944 [ DM-21944 ]
            krzys Krzysztof Findeisen made changes -
            Story Points 4 2
            Description Create a {{PipelineTask}} whose {{runQuantum}} method includes all of the logic in {{ApPipeTask.runAssociation}}.

            This should probably be done after DM-21877, so it can use the same approach to signal completion of PPDB writes to downstream PipelineTasks.

            This work should be straightforward on its own, but it will be much harder to test before DM-21862 and possibly DM-21874 are done, so I am adding those as blockers as well (though using the gen2to3 on a ImageDifferenceTask outputs generated in Gen2 may make the latter unnecessary).
            Convert the subtask created in DM-21944 into a {{PipelineTask}}.

            This work should be straightforward on its own, but it will be much harder to test before DM-21862 and possibly DM-21874 are done, so I am adding those as blockers as well (though using the gen2to3 on a ImageDifferenceTask outputs generated in Gen2 may make the latter unnecessary).
            krzys Krzysztof Findeisen made changes -
            Link This issue is blocked by DM-21877 [ DM-21877 ]
            krzys Krzysztof Findeisen made changes -
            Sprint AP F19-6 (November) [ 958 ]
            Story Points 2 4
            Description Convert the subtask created in DM-21944 into a {{PipelineTask}}.

            This work should be straightforward on its own, but it will be much harder to test before DM-21862 and possibly DM-21874 are done, so I am adding those as blockers as well (though using the gen2to3 on a ImageDifferenceTask outputs generated in Gen2 may make the latter unnecessary).
            Create a {{PipelineTask}} whose {{runQuantum}} method includes all of the logic in {{ApPipeTask.runAssociation}}.

            This should probably be done after DM-21877, so it can use the same approach to signal completion of PPDB writes to downstream PipelineTasks.

            It's not clear what to do about ownership of {{ApPipeTask.ppdb}}. It must belong to the new task in Gen 3, but doing so will break config overrides in Gen 2 (and the DB location is _always_ overridden).
            krzys Krzysztof Findeisen made changes -
            Link This issue is blocked by DM-21877 [ DM-21877 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue is blocked by DM-21874 [ DM-21874 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue is blocked by DM-21862 [ DM-21862 ]
            krzys Krzysztof Findeisen made changes -
            Rank Ranked lower
            ebellm Eric Bellm made changes -
            Assignee Krzysztof Findeisen [ krzys ] Eric Bellm [ ebellm ]
            ebellm Eric Bellm made changes -
            Assignee Eric Bellm [ ebellm ] Chris Morrison [ cmorrison ]
            ebellm Eric Bellm made changes -
            Story Points 4 6
            ebellm Eric Bellm made changes -
            Story Points 6 8
            ebellm Eric Bellm made changes -
            Summary Create PipelineTask driver for ap_pipe tasks that interact with the PPDB Create PipelineTask driver for ap_pipe tasks that interact with the APDB
            ebellm Eric Bellm made changes -
            Description Create a {{PipelineTask}} whose {{runQuantum}} method includes all of the logic in {{ApPipeTask.runAssociation}}.

            This should probably be done after DM-21877, so it can use the same approach to signal completion of PPDB writes to downstream PipelineTasks.

            It's not clear what to do about ownership of {{ApPipeTask.ppdb}}. It must belong to the new task in Gen 3, but doing so will break config overrides in Gen 2 (and the DB location is _always_ overridden).
            Create a {{PipelineTask}} whose {{runQuantum}} method includes all of the logic in {{ApPipeTask.runAssociation}}.

            This should probably be done after DM-21877, so it can use the same approach to signal completion of APDB writes to downstream PipelineTasks.

            It's not clear what to do about ownership of {{ApPipeTask.ppdb}}. It must belong to the new task in Gen 3, but doing so will break config overrides in Gen 2 (and the DB location is _always_ overridden).
            ebellm Eric Bellm made changes -
            Epic Link DM-21442 [ 423049 ]
            cmorrison Chris Morrison made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            cmorrison Chris Morrison made changes -
            Link This issue is blocked by DM-22478 [ DM-22478 ]
            swinbank John Swinbank made changes -
            Sprint AP F19-6 (November) [ 958 ] AP F19-6 (November), AP S20-1 (December) [ 958, 981 ]
            swinbank John Swinbank made changes -
            Epic Link DM-21442 [ 423049 ] DM-22633 [ 427742 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-22663 [ DM-22663 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-22663 [ DM-22663 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-22663 [ DM-22663 ]
            cmorrison Chris Morrison made changes -
            Reviewers Ian Sullivan [ sullivan ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            sullivan Ian Sullivan made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            cmorrison Chris Morrison made changes -
            Link This issue is triggering DM-22741 [ DM-22741 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue blocks DM-22663 [ DM-22663 ]
            cmorrison Chris Morrison made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]

              People

              • Assignee:
                cmorrison Chris Morrison
                Reporter:
                jbosch Jim Bosch
                Reviewers:
                Ian Sullivan
                Watchers:
                Chris Morrison, Eric Bellm, Ian Sullivan, Jim Bosch, Krzysztof Findeisen
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel