Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Story Points:2.8
-
Epic Link:
-
Team:SQuaRE
Attachments
Issue Links
- relates to
-
- Done
Activity
kube-backup provides a Dockerfile which installs aws cli, kubectl, mysqldump and other dependencies and a well structured bash script where tasks to backup files or db dumps are defined.
A new image was built and pushed to lsstsqre/kube-backup:latest
In order to use it we just needed to create a kubernetes secret to store AWS credentials, the S3 bucket URI where we want to store the backups and a web hook URL for Slack Integration.
Automated the creation of the squash-db-backup secret and the cronjob to schedule database backups:
|
|
$ make squash-db-backup
|
Creating backup secret
|
kubectl delete --ignore-not-found=true secrets squash-db-backup
|
secret "squash-db-backup" deleted
|
kubectl create secret generic squash-db-backup \
|
--from-literal=AWS_ACCESS_KEY_ID=*******
|
--from-literal=AWS_SECRET_ACCESS_KEY=******* \
|
--from-literal=S3_BUCKET=******* \
|
--from-literal=SLACK_WEBHOOK=********
|
secret "squash-db-backup" created
|
Schedule periodic backups for squash-db
|
kubectl delete --ignore-not-found=true cronjob squash-db-backup
|
cronjob "squash-db-backup" deleted
|
kubectl create -f kubernetes/squash-db-backup.yaml
|
cronjob "squash-db-backup" created
|
Schedule squash-db backups each 10 min for testing
$ kubectl get cronjob
|
NAME SCHEDULE SUSPEND ACTIVE LAST-SCHEDULE
|
squash-db-backup */10 * * * * False 1 Thu, 05 Oct 2017 10:20:00 -0700
|
Automate backups for squash-db
https://github.com/lsst-sqre/squash-db/pull/4
and minimal changes required in kube-backup utility to work with the squash deployment:
Tested in `squash-prod` deployment, slack integration is working too.
Adopting a solution from https://github.com/whereisaaron/kube-backup
After a few changes I managed to make it work with squash-deployment
$ kubectl run --attach --rm --restart=Never kube-backup --image lsstsqre/kube-backup:latest -- --task=backup-mysql-exec --namespace=demo --pod=squash-db-1790786895-cx70z --container=mariadbFetched AWS credientials from 'kube-backup' secretNo database specified, getting database name from environment of container 'mariadb'Backing up MySQL database 'qadb' from container 'mariadb' in pod 'squash-db-1790786895-cx70z' to 's3://jenkins-prod-qadb.lsst.codes-backups/demo/20171004-2116/squash-db-mariadb-qadb-20171004-2116.gz'Backed up MySQL database 'qadb' from container 'mariadb' in pod 'squash-db-1790786895-cx70z' to 's3://jenkins-prod-qadb.lsst.codes-backups/demo/20171004-2116/squash-db-mariadb-qadb-20171004-2116.gz'Done