Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23961

Dump Summit EFD data and restore at NCSA before the Observatory Shutdwon

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Dump Summit EFD databases and restore them at NCSA Integration cluster along with the Chronograf dashboards. This needs to be done March 19 before the Observatory shuts down because of the Covid-19 outbreak.

        Attachments

          Issue Links

            Activity

            Hide
            afausti Angelo Fausti added a comment -

            During this work, I saw the following data transfer rates

            • From the Summit to NCSA: 6-9 MB/s
            • From the Summit to the base: 80-95 MB/s
            • From the Summit to Tucson: 6-9 MB/s

            It took about 4 hours to transfer the 150GB compressed dump of the database to NCSA over the commodity network.

            A copy is also available in Tucson and at the Base Facility. Commands used for data transfer:

            [afausti@efd-temp-k3s backups]$ ssh -L 1234:lsst-bastion01:22 cerberus4.ncsa.illinois.edu
            [afausti@efd-temp-k3s backups]$ scp -r -P 1234 summit-efd-2020-03-19.influx afausti@127.0.0.1:/home/afausti/  (127.0.0.1 is the bastion host)
            

            [afausti@efd-temp-k3s backups]$ scp -r summit-efd-2020-03-19.influx afausti@lazuli01.ls.lsst.org:/data/afausti
            

            [afausti@efd-temp-k3s backups]$ scp -r summit-efd-2020-03-19.influx afausti@140.252.32.142:/d3/   
            

            Show
            afausti Angelo Fausti added a comment - During this work, I saw the following data transfer rates From the Summit to NCSA: 6-9 MB/s From the Summit to the base: 80-95 MB/s From the Summit to Tucson: 6-9 MB/s It took about 4 hours to transfer the 150GB compressed dump of the database to NCSA over the commodity network. A copy is also available in Tucson and at the Base Facility. Commands used for data transfer: [afausti@efd-temp-k3s backups]$ ssh -L 1234:lsst-bastion01:22 cerberus4.ncsa.illinois.edu [afausti@efd-temp-k3s backups]$ scp -r -P 1234 summit-efd-2020-03-19.influx afausti@127.0.0.1:/home/afausti/ (127.0.0.1 is the bastion host) [afausti@efd-temp-k3s backups]$ scp -r summit-efd-2020-03-19.influx afausti@lazuli01.ls.lsst.org:/data/afausti [afausti@efd-temp-k3s backups]$ scp -r summit-efd-2020-03-19.influx afausti@140.252.32.142:/d3/
            Hide
            afausti Angelo Fausti added a comment - - edited

            Commands used to restore the databases in the Integration cluster at NCSA:

            bash-4.4# kubectl -n influxdb cp ./summit-efd-2020-03-19.influx influxdb-0:./summit-efd-2020-03-19.influx
            bash-4.4# influxd restore -portable -db efd ./summit-efd-2020-03-19.influx
            

            bash-4.4# kubectl -n influxdb cp ./summit-chronograf-2020-03-19.influx influxdb-0:./summit-chronograf-2020-03-19.influx
            bash-4.4# influxd restore -portable -db chronograf ./summit-chronograf-2020-03-19.influx
            

            Also restored the current dashboards at the Summit to NCSA Integration cluster.

            Show
            afausti Angelo Fausti added a comment - - edited Commands used to restore the databases in the Integration cluster at NCSA: bash-4.4# kubectl -n influxdb cp ./summit-efd-2020-03-19.influx influxdb-0:./summit-efd-2020-03-19.influx bash-4.4# influxd restore -portable -db efd ./summit-efd-2020-03-19.influx bash-4.4# kubectl -n influxdb cp ./summit-chronograf-2020-03-19.influx influxdb-0:./summit-chronograf-2020-03-19.influx bash-4.4# influxd restore -portable -db chronograf ./summit-chronograf-2020-03-19.influx Also restored the current dashboards at the Summit to NCSA Integration cluster.
            Hide
            afausti Angelo Fausti added a comment -

            Chronograf is available at https://lsst-chronograf-int-efd.ncsa.illinois.edu/ and the EFD Python client needs to be configured to point to InfluxDB at https://lsst-influxdb-int-efd.ncsa.illinois.edu/

            Show
            afausti Angelo Fausti added a comment - Chronograf is available at https://lsst-chronograf-int-efd.ncsa.illinois.edu/ and the EFD Python client needs to be configured to point to InfluxDB at https://lsst-influxdb-int-efd.ncsa.illinois.edu/
            Hide
            afausti Angelo Fausti added a comment - - edited

            Updated SQR-034 with information about the NCSA Integration EFD.

            Show
            afausti Angelo Fausti added a comment - - edited Updated SQR-034 with information about the NCSA Integration EFD.

              People

              • Assignee:
                afausti Angelo Fausti
                Reporter:
                afausti Angelo Fausti
                Watchers:
                Angelo Fausti
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel