Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24624

Metric framework development

    Details

    • Epic Name:
      sst-svv-metric-framework-development
    • Team:
      DM Science
    • Cycle:
      Spring 2020

      Description

      Develop a scalable robust framework for scientific performance metrics. This epic completes when the new framework is at a stage that it can replace validate_drp and validate_drp can be deprecated.

        Attachments

          Issue Links

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
          DM-24625

          Evaluate the lsst.verify.tasks framework for performance metrics

          Simon Krughoff To Do
          DM-25664

          Implement a "summary" aggregation metric measurement

          Unassigned To Do
          DM-25663

          Transition aggregation tasks to operate per tract

          Unassigned To Do
          DM-25511

          Replace validate_drp in jenkins

          4 Unassigned To Do
          DM-25509

          Review metrics in ap_verify and port to new framework where possible

          Unassigned To Do
          DM-25508

          Demonstrate scientific parity with validate_drp using new framework on the HSC RC2 dataset

          Jeffrey Carlin To Do
          DM-25504

          Port all metrics executed as library functions to new framework

          Unassigned To Do
          DM-25503

          Port metric AD2 to metric task framework

          1 Unassigned To Do
          DM-25502

          Port metric AD1 to metric task framework

          1 Unassigned To Do
          DM-25501

          Port metric AF2 to metric task framework

          1 Unassigned To Do
          DM-25500

          Port metric AF1 to metric task framework

          1 Unassigned To Do
          DM-25789

          Update PA1 in metric-pipelines-tasks to use all matches instead of sampling 50

          1 Jeffrey Carlin To Do
          DM-25792

          Forward units on to JSON serialization of verify.Job even when NaN

          Simon Krughoff To Do
          DM-24639

          Implement metric AB1 in metric framework

          1 Jeffrey Carlin In Progress
          DM-25507

          Tooling to report to SQuaSH

          8 Simon Krughoff In Progress
          DM-25506

          Improve matching performance

          Simon Krughoff In Progress
           
          DM-23440

          Evaluate the lsst.verify.tasks framework for performance metrics

          Jeffrey Carlin Done
           
          DM-24626

          Demonstrate metrics pipeline can be run on HSC RC2 dataset

          Jeffrey Carlin Done
           
          DM-25437

          Convert metrics pipeline repository to use eups

          2 Simon Krughoff Done
           
          DM-25498

          Port metric PF1 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-25499

          Port metric PA2 to metric task framework

          1 Jeffrey Carlin Done

            Activity

            There are no comments yet on this issue.

              People

              • Assignee:
                jcarlin Jeffrey Carlin
                Reporter:
                lguy Leanne Guy
                Reviewers:
                Leanne Guy
                Watchers:
                John Parejko, Leanne Guy
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  Start date:

                  Summary Panel