Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-5504

Backlog for SQuaSH/EFD tasks

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Epic Name:
      sqre-backlog-squash
    • Team:
      SQuaRE
    • Cycle:
      None

      Description


      At this point, this epic holds backlog items so that they do not get lost.

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
        DM-34167

        EFDclient.packed_time_series

        		Angelo Fausti To Do
        DM-33660

        Handle Slack webhook URL as secret in the Kapacitor Helm chart

        		2.8 Angelo Fausti To Do
        DM-33920

        Add a new Gafaelfawr scope to access Chronograf

        		 1.4 Angelo Fausti To Do
        DM-33732

        Kafka-connect-manager: inject PGUSER and PGPASSWORD into JDBC Sink configuration

        		 0.7 Angelo Fausti To Do
        DM-34009

        Release kafka-connect-manager 1.0.0

        		 2.8 Angelo Fausti To Do
        DM-33969

        Add Amazon S3 connector to Strimzi Kafka image

        		 1.4 Angelo Fausti To Do
        DM-35147

        Missing instrument metadata in Faro for some metrics dispatched to SQuaSH

        		 Simon Krughoff To Do
        DM-30080

        Investigate MirrorMaker 2 behavior under partial failure of Kafka Connect tasks

        		 2.8 Angelo Fausti To Do
        DM-29984

        Schema evolution in the T&S XML and the EFD

        		 5.6 Angelo Fausti To Do
        DM-30642

        Increase the number of partitions for high throughput EFD topics

        		 7 Angelo Fausti To Do
        DM-30641

        Create a Chronograf HA configuration for the Summit EFD

        		 7 Angelo Fausti To Do
        DM-28807

        Investigate why lsst-ts GitHub org doesn't work to authenticate users on Chronograf at NTS

        		 1.4 Angelo Fausti To Do
        DM-28873

        Send MirrorMaker 2 metrics to InfluxDB for monitoring

        		 4.2 Angelo Fausti To Do
        DM-31850

        SQuaSH DB disconnection errors (pymysql.err.InterfaceError)

        		 1.4 Angelo Fausti To Do
        DM-31169

        Chronograf requires frequent re-authentication

        		 1 Angelo Fausti To Do
        DM-28026

        Try Kafka KIP-500 mode (run kafka without zookeeper)

        		 2.8 Angelo Fausti To Do
        DM-32005

        Implement map transformation in kafka-aggregator

        		 5.6 Angelo Fausti To Do
        DM-27481

        Restore 2020-11-08 data from SQuaSH DB to InfluxDB

        		1.4 Angelo Fausti To Do
        DM-26077

        dispatch_verify should warn the user if the measurements list is empty

        		 1.4 Angelo Fausti To Do
        DM-26076

        Implement PUT to update a list of metrics from the SQuaSH API

        		 1.4 Angelo Fausti To Do
        DM-25808

        There's always one message behind on each partition consumed by the Faust consumers

        		 1.4 Angelo Fausti To Do
        DM-25384

        Automate Schema Registry global compatibility mode setting

        		 0.7 Angelo Fausti To Do
        DM-27550

        How to fix kafka when there's mismatch between the schema IDs in the Schema Registry and in the messages, or how to avoid that.

        		 2.8 Angelo Fausti To Do
        DM-24659

        Create InfluxDB users as part of the EFD deployment

        		 1.4 Angelo Fausti To Do
        DM-24823

        Implement SQR-040 the EFD Aggregator technote

        		 4.2 Angelo Fausti To Do
        DM-24812

        Improve how Argo CD apps are enabled/disable in a given EFD environment

        		 1.4 Angelo Fausti To Do
        DM-24473

        Starting multiple Faust workers crashes the test topic example in the kafka-aggregator application.

        		 1.4 Angelo Fausti To Do
        DM-24528

        Investigate window alignment when running multiple Faust agents/workers

        		 1.4 Angelo Fausti To Do
        DM-26986

        Add type annotations to the SQuaSH API

        		 2.8 Angelo Fausti To Do
        DM-26981

        Review SQuaSH API configuration module

        		 1.4 Angelo Fausti To Do
        DM-16485

        Use pytelegraf to instrument the SQuaSH API

        		4.2 Angelo Fausti To Do
        DM-25211

        Add suport to array data type in the kafka-aggregator

        		 2.8 Angelo Fausti To Do
        DM-15562

        Analyze the SQuaSH API repo with Better Code and apply recommendations

        		 2.8 Angelo Fausti To Do
        DM-21884

        InfluxDB Sink connector does not support Avro aliases

        		 2.8 Angelo Fausti To Do
        DM-17082

        Chronograf UI requires frequent re-authentication

        		 1.4 Angelo Fausti To Do
        DM-17080

        Login requests to Chronograf forget destination page

        		 1.4 Angelo Fausti To Do
        DM-17911

        Grant viewer role for LSSTDESC members in SQuaSH

        		 0.7 Angelo Fausti To Do
        DM-17907

        Use Confluent REST Proxy to send data to the efd-kafka cluster

        		2.8 Angelo Fausti To Do
        DM-18583

        Chronograf UI improvement: Fix table cell width with URL content

        		 1.4 Angelo Fausti To Do
        DM-15388

        Implement a control metric in SQuaSH

        		 2.8 Angelo Fausti To Do
        DM-15329

        Make SQuaSH REST API conforms to OpenAPI 3.0 specification

        		 5.6 Angelo Fausti To Do
        DM-9831

        remove bogus decam data from qadb

        		 Unassigned To Do
        DM-8285

        post-qa 1.2.0 validation issues in SQUASH deployment

        		 Jonathan Sick To Do
         
        		DM-22274

        Add chronograf dashboards to the backup script

        		 1.4 Angelo Fausti Done
         
        		DM-18517

        Chronograf UI improvement: Scroll to row does not respect table sort

        		 Angelo Fausti Done
         
        		DM-18059

        Implement periodic backups of the SQuaSH InfluxDB databases

        		 4.2 Angelo Fausti Done
         
        		DM-31717

        Improve kafka-connect-manager logs

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-27454

        ap_verify unable to push to SQuaSH

        		 0.7 Angelo Fausti Won't Fix
         
        		DM-23307

        Test `local-path-provisioner` with securityContext spec

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-23974

        Deploy the EFD replicator at NCSA on the stable cluster

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-16838

        Study best practices for InfluxDB optimization

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-16391

        Improve celery task status report in the SQuaSH API

        		 2.8 Angelo Fausti Won't Fix
         
        		DM-15592

        Improve the SQuaSH API /kpms resource in order to be used in the characterization report

        		2.8 Angelo Fausti Won't Fix
         
        		DM-15747

        Distinguish metrics from different pipelines in SQuaSH display

        		 Angelo Fausti Won't Fix
         
        		DM-21010

        update terraform-efd-k3s to work with changes to terraform-efd

        		 Joshua Hoblitt Won't Fix
         
        		DM-14300

        Provide an example notebook for running lsst.verify and sending results to SQuaSH in the JupyterLab environment

        		 2.8 Angelo Fausti Won't Fix
         
        		DM-11361

        Add OAuth 2.0 for squash-dash microservice

        		2.8 Angelo Fausti Won't Fix
         
        		DM-12654

        Make sure the SQuaSH apps don't break when the API returns null

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-14142

        Simplify definition of validate_drp ADx and AFx metrics in lsst.verify_metrics

        		 2.8 Angelo Fausti Won't Fix
         
        		DM-14105

        Register a bokeh application through the SQuaSH API

        		 4.2 Angelo Fausti Won't Fix
         
        		DM-12195

        Implement `share button` to share the current view of squash

        		1.4 Angelo Fausti Won't Fix
         
        		DM-12192

        Implement validation, serialization, and deserialization using Marshmallow

        		 2.8 Angelo Fausti Won't Fix
         
        		DM-12238

        On squash-api and and squash-dash redirect django logs to the standard output under uwsgi

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-10204

        Make the 'Save' tool active in all bokeh plots to easily get a screenshot

        		 0.5 Angelo Fausti Won't Fix
         
        		DM-10194

        Improve threshold annotations display

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-10175

        Add description, parameters and specification to the diagnostic plots

        		 3.2 Angelo Fausti Won't Fix
         
        		DM-9982

        Handle the case of metrics that don't have a diagnostic plot

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-13179

        Handling nan values in verify JSON outputs

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-10259

        SQuaSH API optmization using Django querysets with Pandas

        		 1.4 Angelo Fausti Won't Fix
         
        		DM-7438

        Need an easier way to spot failing jobs

        		2 Angelo Fausti Won't Fix
         
        		DM-9700

        post-qa should verify data submission

        		 Angelo Fausti Won't Fix
         
        		DM-9694

        run validate_drp chft/decam datasets multiple times per day

        		 Joshua Hoblitt Won't Fix
         
        		DM-8071

        Implement annotations on jobs

        		 4.2 Angelo Fausti Won't Fix
         
        		DM-9330

        Uniqueness of metric name

        		 Angelo Fausti Won't Fix
         
        		DM-4874

        Write a firefly search processor that retrieves image paths from the butler

        		 5 Angelo Fausti Won't Fix
         
        		DM-6990

        Improve testing in SQuaSH prototype

        		 5 Angelo Fausti Won't Fix
         
        		DM-21126

        Investigate SQuaSH API 500 Server Error

        		 2.8 Angelo Fausti Won't Fix
         
        		DM-16452

        Towards a production deployment of the new SQuaSH UI

        		 Angelo Fausti Invalid
         
        		DM-18507

        Chronograf UI improvement: do not apply any function by default on fields

        		1.4 Angelo Fausti Invalid
         
        		DM-15565

        Improve metric name parsing

        		 Angelo Fausti Invalid
         
        		DM-19410

        Add oauth2 for the prometheus dashboard in the efd-kafka deployment

        		 1.4 Angelo Fausti Invalid
         
        		DM-20490

        Migrate secrets used in terraform-efd-k3s to vault

        		 1.4 Angelo Fausti Invalid
         
        		DM-20523

        Uniformize Prometheus, Grafana and Chronograf auth in the DM-EFD deployment

        		 2.8 Angelo Fausti Invalid
         
        		DM-14351

        Server Error: INTERNAL SERVER ERROR for url: https://squash-restful-api-demo.lsst.codes/job

        		 1.4 Angelo Fausti Invalid
         
        		DM-14322

        Create interface to browse metrics definitions and specifications

        		5.6 Angelo Fausti Invalid
         
        		DM-14301

        Accessing verification jobs from the SQuaSH RESTful API and run the SQuaSH drill down plots in JupyterLab

        		 2.8 Angelo Fausti Invalid
         
        		DM-15393

        Implement cookiecutter for squash-bokeh apps

        		 4.2 Angelo Fausti Invalid
         
        		DM-14751

        Implement KPM dashboard in squash-bokeh

        		 7 Angelo Fausti Invalid
         
        		DM-11531

        Add OAuth 2.0 for the squash-restful-api microservice

        		 2.8 Angelo Fausti Invalid
         
        		DM-13516

        Homogenize SQuaSH API return

        		2.8 Angelo Fausti Invalid
         
        		DM-12600

        Implement pagination and caching in the Flask REST API

        		 2.8 Angelo Fausti Invalid
         
        		DM-15317

        Implement model to register datasets in SQuaSH

        		 7 Angelo Fausti Invalid
         
        		DM-13561

        Make list of packages and versions available from the SQuaSH interface

        		 2.8 Angelo Fausti Invalid
         
        		DM-10216

        SQUASH production update S17-1

        		 Joshua Hoblitt Invalid
         
        		DM-13035

        Enable JWT authentication in Swagger UI

        		 1.4 Angelo Fausti Invalid
         
        		DM-9746

        validate_drp cfht/decam datasets timing out post pybind11 merge

        		 Unassigned Invalid
         
        		DM-7334

        Create user guide documentation for squash

        		 7 Angelo Fausti Invalid
         
        		DM-6103

        capture qa dashboard django logs

        		 Joshua Hoblitt Invalid
         
        		DM-6104

        load balance multiple instances of bokeh server

        		 Joshua Hoblitt Invalid

          Activity

          There are no comments yet on this issue.

            People

            Assignee:
            afausti Angelo Fausti
            Reporter:
            frossie Frossie Economou
            Watchers:
            Frossie Economou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:

                Jenkins

                No builds found.