Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-19488

Evaluate the InfluxDB to be the EFD Candidate

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ts_aos
    • Labels:

      Description

      This will evaluate the performance of InfluxDB with the SAL influxwriter on SSD, NVME, and spinning disk.

        Attachments

          Activity

          Hide
          ttsai Te-Wei Tsai added a comment - - edited

          Use "influxd run -config <path>" to test I can set the nvme directory or not. It looks like this does not work at all.

          Try to change the setting and restart the service by following the link:

          https://stackoverflow.com/questions/28350290/how-to-change-location-of-influxdb-storage-folder

          To create the new users:

          https://docs.influxdata.com/influxdb/v1.7/administration/authentication_and_authorization/#user-management-commands 

          Recorded the analysis here:

          https://confluence.lsstcorp.org/display/LTS/InfluxDB+Evaluation+2

          Show
          ttsai Te-Wei Tsai added a comment - - edited Use "influxd run -config <path>" to test I can set the nvme directory or not. It looks like this does not work at all. Try to change the setting and restart the service by following the link: https://stackoverflow.com/questions/28350290/how-to-change-location-of-influxdb-storage-folder To create the new users: https://docs.influxdata.com/influxdb/v1.7/administration/authentication_and_authorization/#user-management-commands   Recorded the analysis here: https://confluence.lsstcorp.org/display/LTS/InfluxDB+Evaluation+2
          Hide
          ttsai Te-Wei Tsai added a comment - - edited

          Follow the following links to install the influx sink:

          https://docs.lenses.io/connectors/sink/influx.html

          https://docs.lenses.io/connectors/stream-reactor-install.html#stream-reactor-install

          I can not restart the workers for the following command:
          `bin/connect-distributed.sh config/connect-distributed.properties`

          I do not see the config directory in the image:

          https://hub.docker.com/r/confluentinc/cp-kafka-connect/

           

          Show
          ttsai Te-Wei Tsai added a comment - - edited Follow the following links to install the influx sink: https://docs.lenses.io/connectors/sink/influx.html https://docs.lenses.io/connectors/stream-reactor-install.html#stream-reactor-install I can not restart the workers for the following command: `bin/connect-distributed.sh config/connect-distributed.properties` I do not see the config directory in the image: https://hub.docker.com/r/confluentinc/cp-kafka-connect/  
          Hide
          ttsai Te-Wei Tsai added a comment -

          Tested the Kafka connector to InfluxDB with and without Kubernetes. Both of them I got the error messages. Since I had been transformed the role to more AOS algorithms and data analysis, I stopped this task at the moment. From the next sprint, my role in the EFD is more like the learning and watching.

          Show
          ttsai Te-Wei Tsai added a comment - Tested the Kafka connector to InfluxDB with and without Kubernetes. Both of them I got the error messages. Since I had been transformed the role to more AOS algorithms and data analysis, I stopped this task at the moment. From the next sprint, my role in the EFD is more like the learning and watching.
          Hide
          dmills Dave Mills added a comment -

          Task interrupted by reassignment to higher priority work

          Show
          dmills Dave Mills added a comment - Task interrupted by reassignment to higher priority work

            People

            Assignee:
            ttsai Te-Wei Tsai
            Reporter:
            ttsai Te-Wei Tsai
            Reviewers:
            Dave Mills
            Watchers:
            Dave Mills, Te-Wei Tsai
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Start date:
              End date:

                Jenkins

                No builds found.