Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16223

Front end interfaces to metrics databases

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: squash
    • Labels:
      None
    • Epic Name:
      sqre-f18-metrics-ui
    • Story Points:
      72
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Fall 2018

      Description

      We are concerned that the custom user interfaces we have been making with bokeh for the SQuaSH UI will not scale to the demands for interactions with EFD data. We will evaluate the following off-the-shelf harnesses for the "monitoring and alerts" system described in DMTN-082

      • honeycomb.io
      • prometheus
      • InfluxDB

      We are then going to stand up one of those systems as a prototype for first, SQuaSH-DB data and then EFD-originating data. 

        Attachments

          Activity

          frossie Frossie Economou created issue -
          frossie Frossie Economou made changes -
          Field Original Value New Value
          Risk Score 0
          afausti Angelo Fausti made changes -
          Epic Child DM-15888 [ 214007 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-15852 [ 212558 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-15639 [ 194117 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16207 [ 229000 ]
          afausti Angelo Fausti made changes -
          Status To Do [ 10001 ] In Progress [ 3 ]
          frossie Frossie Economou made changes -
          Cycle Fall 2018 [ 10807 ]
          frossie Frossie Economou made changes -
          WBS 1.02C.10.02
          afausti Angelo Fausti made changes -
          Epic Child DM-16271 [ 229601 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16293 [ 231540 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16300 [ 231578 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16315 [ 231616 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16334 [ 231772 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16391 [ 233040 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16399 [ 233104 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16448 [ 234466 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16449 [ 234467 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16450 [ 234468 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16452 [ 234471 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16453 [ 234472 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16454 [ 234473 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16484 [ 234583 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16492 [ 234617 ]
          jhoblitt Joshua Hoblitt made changes -
          Epic Child DM-16519 [ 234719 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16485 [ 234601 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16545 [ 234805 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16549 [ 234822 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16605 [ 234975 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16633 [ 235023 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16643 [ 235054 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16660 [ 235088 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16391 [ 233040 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16293 [ 231540 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16315 [ 231616 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16448 [ 234466 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16450 [ 234468 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16452 [ 234471 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16453 [ 234472 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16454 [ 234473 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16485 [ 234601 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16519 [ 234719 ]
          afausti Angelo Fausti made changes -
          Epic Child DM-16643 [ 235054 ]
          afausti Angelo Fausti made changes -
          Reviewers Frossie Economou [ frossie ]
          Status In Progress [ 3 ] In Review [ 10004 ]
          Hide
          frossie Frossie Economou added a comment -

          This epic included test deployments of three metric and visualisation environments with the purpose of replacing the SQuaSH front end experience and also with the eye of supporting commissioning usecases requiring low-latency access to EFD data from the Science Platform. Ultimately we selected and deployed the InfluxDB+chronograf+kapacitor chain for scalar metric visualisation as it offered the best ecosystem of applications for our usecases. However we also had a good experience with the prometheus environment and we will be using it for system monitoring in situations where it is better integrated with the monitored infrastructure (eg k8s services). 

          Show
          frossie Frossie Economou added a comment - This epic included test deployments of three metric and visualisation environments with the purpose of replacing the SQuaSH front end experience and also with the eye of supporting commissioning usecases requiring low-latency access to EFD data from the Science Platform. Ultimately we selected and deployed the InfluxDB+chronograf+kapacitor chain for scalar metric visualisation as it offered the best ecosystem of applications for our usecases. However we also had a good experience with the prometheus environment and we will be using it for system monitoring in situations where it is better integrated with the monitored infrastructure (eg k8s services). 
          frossie Frossie Economou made changes -
          Resolution Done [ 10000 ]
          Status In Review [ 10004 ] Done [ 10002 ]

            People

            • Assignee:
              afausti Angelo Fausti
              Reporter:
              frossie Frossie Economou
              Reviewers:
              Frossie Economou
              Watchers:
              Frossie Economou
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel