Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-6196

SQuaSH capability extension: multiple testdata service

    Details

    • Epic Name:
      sqre-f16-squash-1
    • Story Points:
      92
    • WBS:
      1.02C.10.02
    • Team:
      SQuaRE
    • Cycle:
      Fall 2016

      Description

      This epic covers work to deliver the following improvements to the SQuaSH prototype stood up in X16:

      • drilldown 1 level (time series->histogram)
      • multiple testdata options (requires jenkins, backend, dashboard extension)
      • processccd + validate_drp pseudo-workflow
      • pseudo-provenance (track manifest.txt - real LSST provenance system will be swapped in for extensive functionality when available)

        Attachments

          Issue Links

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-8573

          Cleanup validate_base Datum input value handling

          0.1 Jonathan Sick Done
           
          DM-8561

          Filter null measurements in post-qa

          1 Jonathan Sick Done
           
          DM-8558

          Make metrics.yaml installable with validate_drp

          0.2 Jonathan Sick Done
           
          DM-8557

          SWIG in Python 3 does not accept numpy.int64 types as an index

          0.6 Jonathan Sick Done
           
          DM-8501

          Update SQUASH design documentation for F16

          1 Angelo Fausti Done
           
          DM-8414

          Investigate alternatives to ingest JSON blobs into the SQUASH database

          4 Angelo Fausti Done
           
          DM-8368

          Improvements on code change feature

          2 Angelo Fausti Done
           
          DM-8398

          deploy squash improvements in code changes feature

          0.333 Joshua Hoblitt Done
           
          DM-8195

          deploy squash code changes feature

          1.5 Joshua Hoblitt Done
           
          DM-7581

          Use box annotations to indicate missing jobs

          2.5 Angelo Fausti Done
           
          DM-7749

          Update squash production environment

          1 Joshua Hoblitt Done
           
          DM-7737

          Port of validate_base to Python 3

          0.7 Jonathan Sick Done
           
          DM-7682

          Create a new fixture for loading test data

          1.5 Angelo Fausti Done
           
          DM-7612

          Separate the presentation layer from API access in the metrics app

          2 Angelo Fausti Done
           
          DM-7441

          Manage multiple bokeh apps

          5 Angelo Fausti Done
           
          DM-7427

          Improve display of metric thresholds

          4 Angelo Fausti Done
           
          DM-7216

          deploy squash bokeh driven views

          3 Joshua Hoblitt Done
           
          DM-7517

          Fix ordering when returning jobs from the api

          1 Angelo Fausti Done
           
          DM-7328

          Port validate_drp to Python 3

          0.5 Jonathan Sick Done
           
          DM-7098

          Add two more env variables from jenkins in the JSON gerenated by post_qa

          0.5 Angelo Fausti Done
           
          DM-7082

          deploy django admin interface fix

          0.75 Joshua Hoblitt Done
           
          DM-7071

          Fix Django admin interface

          1 Angelo Fausti Done
           
          DM-7006

          Update squash to use bokeh 0.12.1

          1 Angelo Fausti Done
           
          DM-7005

          List the code changes from job to job and link the package names with the corresponding git url

          20 Angelo Fausti Done
           
          DM-6992

          Use Bokeh views entirely for dashboard

          10 Angelo Fausti Done
           
          DM-6917

          Write User Guide for new validate_drp metric/measurement API

          4.2 Jonathan Sick Done
           
          DM-6629

          validate_drp: design and implement an API for metric measurements and serializations

          22 Jonathan Sick Done
           
          DM-5945

          Implement validate_drp static plots in Bokeh as proof-of-concept for SQUASH

          10 Angelo Fausti Done

            Activity

            Hide
            afausti Angelo Fausti added a comment -

            In this epic we extended SQuaSH to support multiple datasets and shipped the "Code Changes" feature and implemented the validate_drp plots using Bokeh as a proof of concept.

            https://squash.lsst.codes/

            Examples of validate_drp plots using Bokeh are available in my testing instance:

            https://angelo-squash-bokeh.lsst.codes/astrometry
            https://angelo-squash-bokeh.lsst.codes/photometry

            Show
            afausti Angelo Fausti added a comment - In this epic we extended SQuaSH to support multiple datasets and shipped the "Code Changes" feature and implemented the validate_drp plots using Bokeh as a proof of concept. https://squash.lsst.codes/ Examples of validate_drp plots using Bokeh are available in my testing instance: https://angelo-squash-bokeh.lsst.codes/astrometry https://angelo-squash-bokeh.lsst.codes/photometry
            Hide
            frossie Frossie Economou added a comment - - edited

            I have tested the deployment on the staging environment and ignoring some minor UX nitpicks it's ready to greenlight this for deployment in the next SQuaSH upgrade window.

            The "drilldown" supports allows the inspection of sources that were used in calculating a particular metric in plots similar to those presented in http://dmtn-008.lsst.io/en/latest/ . It also allows for an interactive change of the cut-off to indicate the relative contribution of these sources in linked graphs. The CI system is mocking a workflow that links the processing of data with an afterburner calculating the metrics. The "provenance" of the metrics is tracked so that the user can be taken to the code changes that were involved in the metric shown in the regression graph. Additionally, extensive re-engineering to decompose the application in separate bokeh apps and to support the validate_base split-off from validate_drp was performed.

            Great work Angelo. Looking forward to seeing it in prod.

            Show
            frossie Frossie Economou added a comment - - edited I have tested the deployment on the staging environment and ignoring some minor UX nitpicks it's ready to greenlight this for deployment in the next SQuaSH upgrade window. The "drilldown" supports allows the inspection of sources that were used in calculating a particular metric in plots similar to those presented in http://dmtn-008.lsst.io/en/latest/ . It also allows for an interactive change of the cut-off to indicate the relative contribution of these sources in linked graphs. The CI system is mocking a workflow that links the processing of data with an afterburner calculating the metrics. The "provenance" of the metrics is tracked so that the user can be taken to the code changes that were involved in the metric shown in the regression graph. Additionally, extensive re-engineering to decompose the application in separate bokeh apps and to support the validate_base split-off from validate_drp was performed. Great work Angelo. Looking forward to seeing it in prod.

              People

              • Assignee:
                afausti Angelo Fausti
                Reporter:
                frossie Frossie Economou
                Reviewers:
                Frossie Economou
                Watchers:
                Angelo Fausti, Frossie Economou
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel