Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14122

Make LTD Keeper PATCH /builds/<id> asynchronous

    Details

      Description

      After a client uploads documentation to LTD’s S3 bucket, they must do a PATCH /builds/<id> call to tell the API that the build is complete. When this happens, the LTD Keeper app determines if the new build corresponds to an edition. If so, it copies the build over to become the new edition in the S3 bucket. For large sites, this takes a significant amount of time since actual data is being copied in the S3 bucket. The result is that the PATCH call routinely times out and produces a 503 server error.

      The solution is to make this post processes asynchronous with the client API handling. Being a Flask app, we already have experience using Celery in Kubernetes to implement asynchronous tasks.

      The goal of this ticket is:

      1. Add celery to LTD Keeper and its Kubernetes deployment
      2. Refactor the edition update into a Celery task.

        Attachments

          Activity

          jsick Jonathan Sick created issue -
          jsick Jonathan Sick made changes -
          Field Original Value New Value
          Epic Link DM-13773 [ 39319 ]
          jsick Jonathan Sick made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          jsick Jonathan Sick made changes -
          Story Points 0.7
          jsick Jonathan Sick made changes -
          Story Points 0.7 4.9
          jsick Jonathan Sick made changes -
          Risk Score 0
          jsick Jonathan Sick made changes -
          Story Points 4.9 6.3
          jsick Jonathan Sick made changes -
          Story Points 6.3 7.2
          jsick Jonathan Sick made changes -
          Story Points 7.2 10
          jsick Jonathan Sick made changes -
          Story Points 10 11.4
          jsick Jonathan Sick made changes -
          Story Points 11.4 12.8
          jsick Jonathan Sick made changes -
          Story Points 12.8 15.6
          jsick Jonathan Sick made changes -
          Story Points 15.6 16.3
          jsick Jonathan Sick made changes -
          Resolution Done [ 10000 ]
          Status In Progress [ 3 ] Done [ 10002 ]

            People

            • Assignee:
              jsick Jonathan Sick
              Reporter:
              jsick Jonathan Sick
              Watchers:
              Jonathan Sick
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel