Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18730

Research the InfluxDB and Kafka

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ts_aos
    • Labels:

      Description

      Do the research of InfluxDB and Kafka and learn how to use them. This is based on the discussion of EFD meeting:

      https://confluence.lsstcorp.org/pages/viewpage.action?spaceKey=LTS&title=2019-03-29+EFD+Meeting+notes

       

        Attachments

        1. image-2019-04-08-11-27-08-038.png
          image-2019-04-08-11-27-08-038.png
          79 kB
        2. image-2019-04-08-12-40-50-590.png
          image-2019-04-08-12-40-50-590.png
          78 kB
        3. image-2019-04-08-13-45-28-673.png
          image-2019-04-08-13-45-28-673.png
          81 kB
        4. image-2019-04-10-16-06-25-706.png
          image-2019-04-10-16-06-25-706.png
          23 kB
        5. image-2019-04-10-16-07-24-258.png
          image-2019-04-10-16-07-24-258.png
          22 kB
        6. image-2019-04-10-16-16-49-853.png
          image-2019-04-10-16-16-49-853.png
          26 kB
        7. image-2019-04-11-08-02-44-087.png
          image-2019-04-11-08-02-44-087.png
          12 kB
        8. image-2019-04-11-12-45-36-159.png
          image-2019-04-11-12-45-36-159.png
          19 kB
        9. image-2019-04-11-12-47-23-400.png
          image-2019-04-11-12-47-23-400.png
          18 kB
        10. image-2019-04-11-12-48-25-430.png
          image-2019-04-11-12-48-25-430.png
          40 kB
        11. image-2019-04-11-15-09-55-250.png
          image-2019-04-11-15-09-55-250.png
          134 kB
        12. influxdb_2017.pdf
          2.34 MB
        13. test_influxDB_http.py
          0.7 kB
        14. test_influxDB.py
          0.8 kB

          Activity

          Hide
          ttsai Te-Wei Tsai added a comment - - edited

          Discussed the archive of influxDB data with Simon. He mentioned that DM might have multiple databases for different purposes. The following is what he said:

          Show
          ttsai Te-Wei Tsai added a comment - - edited Discussed the archive of influxDB data with Simon. He mentioned that DM might have multiple databases for different purposes. The following is what he said:
          Hide
          ttsai Te-Wei Tsai added a comment -

          After the discussion with Dave, the multiple databases on multiple tiers is a possible choice (in the worst case).

          Show
          ttsai Te-Wei Tsai added a comment - After the discussion with Dave, the multiple databases on multiple tiers is a possible choice (in the worst case).
          Hide
          ttsai Te-Wei Tsai added a comment -
          Show
          ttsai Te-Wei Tsai added a comment - Work around the influxDB cluster: https://www.thumbtack.com/engineering/high-availability-for-influxdb/  
          Hide
          ttsai Te-Wei Tsai added a comment -

          I organized my study as the following:

          https://confluence.lsstcorp.org/display/LTS/Evaluation+of+InfluxDB

          Please review it and discuss the actions.

          Show
          ttsai Te-Wei Tsai added a comment - I organized my study as the following: https://confluence.lsstcorp.org/display/LTS/Evaluation+of+InfluxDB Please review it and discuss the actions.
          Hide
          dmills Dave Mills added a comment -

          Excellent start on installing and configuration of InfluxDB

          Show
          dmills Dave Mills added a comment - Excellent start on installing and configuration of InfluxDB

            People

            Assignee:
            ttsai Te-Wei Tsai
            Reporter:
            ttsai Te-Wei Tsai
            Reviewers:
            Dave Mills
            Watchers:
            Christopher Stephens [X] (Inactive), Dave Mills, Te-Wei Tsai
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Start date:
              End date:

                Jenkins

                No builds found.