Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9508

Automated replication of the lsst-the-docs S3 bucket

    XMLWordPrintable

    Details

      Description

      Although S3 is durable against data loss, there's a risk that programmatic errors can result in data loss. A prudent solution is to periodically replicate the lsst-the-docs S3 bucket to make it possible to recover data. This isn't a complete backup (solution; it'd be good to have cold storage like AWS Glacier, but it's a start.

      Possible solution: https://eladnava.com/backing-up-your-amazon-s3-buckets-to-ec2/ (discusses using the AWS CLI to trigger S3 bucket replication).

        Attachments

          Issue Links

            Activity

            No builds found.
            jsick Jonathan Sick created issue -
            jsick Jonathan Sick made changes -
            Field Original Value New Value
            Epic Link DM-8475 [ 28107 ]
            Hide
            jsick Jonathan Sick added a comment -

            Using AWS CLI:

            aws s3 sync s3://lsst-the-docs s3://lsst-the-docs-replica-1 --profile=jsick-lsst
            

            Show
            jsick Jonathan Sick added a comment - Using AWS CLI: aws s3 sync s3://lsst-the-docs s3://lsst-the-docs-replica-1 --profile=jsick-lsst
            jsick Jonathan Sick made changes -
            Epic Link DM-8475 [ 28107 ] DM-6187 [ 24703 ]
            gcomoretto Gabriele Comoretto [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 26013 ]
            Hide
            tjenness Tim Jenness added a comment -

            Jonathan Sick what's the status of this ticket?

            Show
            tjenness Tim Jenness added a comment - Jonathan Sick what's the status of this ticket?
            Hide
            jsick Jonathan Sick added a comment -

            This ticket is To-do and still relevant.

            Show
            jsick Jonathan Sick added a comment - This ticket is To-do and still relevant.

              People

              Assignee:
              jsick Jonathan Sick
              Reporter:
              jsick Jonathan Sick
              Watchers:
              Jonathan Sick, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:

                  CI Builds

                  No builds found.