Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12787

Science Quality Monitoring and Testing

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Templates:
      SQuaRE Epic
    • Epic Name:
      sqre-s18-squash-1
    • Story Points:
      82.5
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Spring 2018

      Description

      This epic focuses on metric monitoring and visualisation both through the SQuaSH harness and the JupyterLab-based Notebook Environment of the LSST Science Platform.

      This epic includes a migration to the Flask API to eliminate DJANGO from our toolchain and make SQuaSH technically consistent with other SQuaRE services

      A major deliverable for S18 is to provide a document or tutorial of the current capabilities of the platform and seek input from the DM teams on priorities for further development.

      (Note this epic will start late as the epics behind it are not closed yet).

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        DM-9741

        Implement a minimal viable REST API in Flask with a test client

        7 Angelo Fausti Done
         
        DM-9242

        squash KPM plots should label the time axis with a timezone

        0.5 Angelo Fausti Done
         
        DM-8836

        Implement versioning in SQuaSH REST API

        1.4 Angelo Fausti Done
         
        DM-14277

        Fix dataset names in squash and add ability to ignore a particular dataset

        1.4 Angelo Fausti Done
         
        DM-13275

        Upload verification job and data blobs to an S3 bucket using Celery

        4.2 Angelo Fausti Done
         
        DM-13237

        Implement authentication via access token in lsst.verify

        1.4 Angelo Fausti Done
         
        DM-13236

        Create the /monitor resource in the Flask REST API to feed the monitor app

        2.8 Angelo Fausti Done
         
        DM-14254

        Miscellaneous fixes

        1.4 Angelo Fausti Done
         
        DM-12606

        Refactor bokeh apps for accessing data from the Flask REST API and from S3

        4.2 Angelo Fausti Done
         
        DM-12604

        Migrate SQuaSH data from the current production database to the new database schema

        8 Adam Thornton Done
         
        DM-12603

        Deployment of the squash-restful-api service

        2.8 Angelo Fausti Done
         
        DM-12601

        Implement flasgger for the SQuaSH REST API documentation

        2.8 Angelo Fausti Done
         
        DM-14185

        Set up a sandbox instance for SQuaSH

        7 Angelo Fausti Done
         
        DM-14180

        Fix nagios checks after new squash deployment

        0.2 Angelo Fausti Done
         
        DM-14151

        Set up a new production instance and synchronize databases

        4.2 Angelo Fausti Done
         
        DM-13994

        Add code changes back to the Monitor app

        5.6 Angelo Fausti Done
         
        DM-13174

        Redirect root URL to /apidocs

        0.2 Angelo Fausti Done
         
        DM-13446

        Redeploy squash-api to a n1-standard-4 node

        1.4 Angelo Fausti Done
         
        DM-13414

        Create the /code_changes resource in the Flask REST API to feed the monitor app

        2.8 Angelo Fausti Done
         
        DM-13398

        Tests of squash-restful-api with current test datasets used in CI

        2.8 Angelo Fausti Done
         
        DM-13394

        Increase default http timeout in lsst.verify

        1.4 Angelo Fausti Done
         
        DM-13490

        Retrieve status of job creation from the API

        2.8 Angelo Fausti Done
         
        DM-12964

        Implement tests for the SQuaSH REST API

        2.8 Angelo Fausti Done
         
        DM-12807

        Migrate SQuaSH database to Google Cloud SQL

        1.4 Angelo Fausti Done
         
        DM-12194

        Redesign SQuaSH REST API to make it complaint with lsst.verify

        7 Angelo Fausti Done
         
        DM-12191

        Definition of the Flask extensions to be used in the SQuaSH REST API

        4.2 Angelo Fausti Done

          Activity

            People

            • Assignee:
              afausti Angelo Fausti
              Reporter:
              frossie Frossie Economou
              Reviewers:
              Frossie Economou
              Watchers:
              Angelo Fausti, Frossie Economou
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel