Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14019

Allow ap_pipe to skip association

    Details

    • Type: Improvement
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_pipe
    • Story Points:
      1
    • Epic Link:
    • Sprint:
      AP S19-2
    • Team:
      Alert Production

      Description

      Once ap_association supports it, ap_pipe should query the association database to see if a dataId has already been processed. This will allow ap_pipe to skip all processing steps that have already been performed.

        Attachments

          Issue Links

            Activity

            Hide
            krzys Krzysztof Findeisen added a comment -

            Hi Chris Morrison, could you please review this 70-line feature? Thanks!

            Show
            krzys Krzysztof Findeisen added a comment - Hi Chris Morrison , could you please review this 70-line feature? Thanks!
            Hide
            cmorrison Chris Morrison added a comment -

            Looks good. I've approved the pull requests. One comment that is worth making outside of those is that some warning should be communicated for allowing association to be re-run is that the association and Ppdb are temporally sensitive. That is if you lose a ccd say in processing and come back and re-do it, the resultant associations and Ppdb will not be the same. There may even be some weirdness with the DiaObjects themselves based on how ValidityStart and ValidityEnd are used in the Ppdb.

            Show
            cmorrison Chris Morrison added a comment - Looks good. I've approved the pull requests. One comment that is worth making outside of those is that some warning should be communicated for allowing association to be re-run is that the association and Ppdb are temporally sensitive. That is if you lose a ccd say in processing and come back and re-do it, the resultant associations and Ppdb will not be the same. There may even be some weirdness with the DiaObjects themselves based on how ValidityStart and ValidityEnd are used in the Ppdb.

              People

              • Assignee:
                krzys Krzysztof Findeisen
                Reporter:
                krzys Krzysztof Findeisen
                Reviewers:
                Chris Morrison
                Watchers:
                Chris Morrison, Krzysztof Findeisen
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: