Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-14312

QA analysis and monitoring in SQuaSH and JupyterLab

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      sqre-f18-squash-2
    • Story Points:
      65
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Fall 2018

      Description

      This epic covers the development of SQuaSH in F18-A. The current developmental roadmap is user-specific configurations so that a user who is only interested in, say, JOINTCAL metrics doesn't have to routinely wade through all the KPMs to find them.

      This epic is currently holding the SQuaSH backlog. We expect significant additions and reprioritisation of the backlog will occur with the new DM Subsystem Scientist and the outcome of the QA Working Group and epic will be updated to capture that. 

        Attachments

        Stories in Epic (Custom Issue Matrix)

        Key Summary Story Points Assignee Status
         
        		DM-15407

        Update env metadata for HSC RC2 processing

        		 0.2 Angelo Fausti Done
         
        		DM-15403

        Implement continuous delivery for squash docker images

        		 2.8 Angelo Fausti Done
         
        		DM-15387

        Design a procedure for updating SQuaSH production instance

        		 1.4 Angelo Fausti Done
         
        		DM-15386

        Add specification thresholds back to the code_changes app

        		 2.8 Angelo Fausti Done
         
        		DM-15359

        Query API resources by filter_name

        		1.4 Angelo Fausti Done
         
        		DM-16225

        QA WG activities

        		 7 Angelo Fausti Done
         
        		DM-11940

        Distinguish measurements made on different bands in squash

        		 2.8 Angelo Fausti Done
         
        		DM-14925

        Change TE1, TE2 plots to show expected range of 10^-5

        		 3.2 Angelo Fausti Done
         
        		DM-15535

        Enabled API tests on travis ci

        		 1.4 Angelo Fausti Done
         
        		DM-14804

        SelectionSet.load_single_package fails silently

        		 0.5 Angelo Fausti Done
         
        		DM-14731

        Using the Bokeh models API to create new charts

        		 3.2 Angelo Fausti Done
         
        		DM-14376

        Display TE1 and TE2 metrics in more appropriate units in SQuaSH

        		 1.4 Angelo Fausti Done
         
        		DM-14357

        Gather metadata entries from the LDF environment in dispatch_verify.py

        		 1.4 Angelo Fausti Done
         
        		DM-14550

        Add new command line option '--ignore-blobs' to dispatch_verify.py

        		 1.4 Angelo Fausti Done
         
        		DM-14672

        Support LDF environment - unknown filters

        		 1.4 Angelo Fausti Done
         
        		DM-14328

        Publish verification jobs produced by the HSC reprocessing to SQuaSH

        		 7 Angelo Fausti Done
         
        		DM-9293

        squash support for multiple filters per dataset

        		 2.8 Angelo Fausti Done
         
        		DM-9243

        squash KPM plot points are ~8 hours ahead of UTC

        		 1.4 Angelo Fausti Done
         
        		DM-9876

        [some] validate_drp derived metric values visualization is mangled in dashboard

        		 Angelo Fausti Done
         
        		DM-15474

        Implement HTTP PUT for metrics and specifications resources

        		1.4 Angelo Fausti Done
         
        		DM-15255

        Metric description does not update

        		 0.5 Angelo Fausti Done
         
        		DM-15240

        Create resource in the squash-restful-api for the KPMs dashboard

        		7 Angelo Fausti Done
         
        		DM-15165

        Add new tags for validate_drp metric definition and specifications

        		 4.2 Angelo Fausti Done

          Activity

          Hide
          Permalink
          frossie Frossie Economou added a comment -

          All work in this epic is live in production at squash.lsst.codes (except for the contributions to the QA working group which is still working on its final report). Of particular note is the addition of metrics from the HSC reprocessing. 

          During this epic it became clear that the work on the front end of visualisation is taking too much effort and in the consecutive epic (DM-16223) we will be investigating off-the-shelf front end frameworks for adoption so we can focus on domain-specific metric curation. 

          Show
          frossie Frossie Economou added a comment - All work in this epic is live in production at squash.lsst.codes (except for the contributions to the QA working group which is still working on its final report). Of particular note is the addition of metrics from the HSC reprocessing.  During this epic it became clear that the work on the front end of visualisation is taking too much effort and in the consecutive epic ( DM-16223 ) we will be investigating off-the-shelf front end frameworks for adoption so we can focus on domain-specific metric curation. 

            People

            Assignee:
            afausti Angelo Fausti
            Reporter:
            frossie Frossie Economou
            Reviewers:
            Frossie Economou
            Watchers:
            Frossie Economou
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.