Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16300

Implement a celery task in the SQuaSH API to save time series data to InfluxDB

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The SQuaSH API already has the capability of executing Celery tasks, e.g. we have a task to upload verification jobs to S3.

      It makes sense to implement another task to send the time series data (metric values, tags, and timestamps) to InfluxDB.

      The transformation of a SQuaSH job to InfluxDB line maps each verification package to an InfluxDB measurement, job metadata to InfluxDB tags and metric names and values to fields.

        Attachments

          Issue Links

            Activity

            Hide
            afausti Angelo Fausti added a comment -

            Merged.

            Show
            afausti Angelo Fausti added a comment - Merged.
            Show
            afausti Angelo Fausti added a comment - https://github.com/lsst-sqre/squash-restful-api/pull/38
            Hide
            afausti Angelo Fausti added a comment -

            This implementation was tested in DM-16399.

            Show
            afausti Angelo Fausti added a comment - This implementation was tested in DM-16399 .
            Hide
            afausti Angelo Fausti added a comment -

            Attached diagram showing the SQuaSH API sending TS data to InfluxDB. The use of Chronograph for visualization and Kapacitor for Alerting.

            Show
            afausti Angelo Fausti added a comment - Attached diagram showing the SQuaSH API sending TS data to InfluxDB. The use of Chronograph for visualization and Kapacitor for Alerting.

              People

              • Assignee:
                afausti Angelo Fausti
                Reporter:
                afausti Angelo Fausti
                Watchers:
                Angelo Fausti
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: