Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24624

Development of new package for computing metrics

    XMLWordPrintable

    Details

    • Epic Name:
      sst-svv-metric-framework-development
    • Team:
      DM Science
    • Cycle:
      Spring 2020

      Description

      Develop a scalable robust framework for computing scientific performance metrics based on the Gen3 middleware. This epic completes when the new framework is at a stage that it can replace validate_drp and validate_drp can be deprecated.

        Attachments

          Issue Links

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-28235

          External astrometric calibration not being applied correctly in faro

          2 Jeffrey Carlin Done
           
          DM-27307

          Add unit tests for stellar locus metric

          2 Jeffrey Carlin Done
           
          DM-26877

          Fix metric_pipeline_tasks to use band instead abstract_filter

          1 Simon Krughoff Done
           
          DM-26837

          Forward both abstract and physical filter names to SQuaSH

          1 Simon Krughoff Done
           
          DM-26839

          Make sure the correct return code is supplied by the gen3 validate_drp scrips

          2 Simon Krughoff Done
           
          DM-27135

          The values for AB1 for r and i band are identical

          4 Simon Krughoff Done
           
          DM-26958

          Fix ADx, AFx calculation to subtract off the median residual

          2 Jeffrey Carlin Done
           
          DM-26569

          Create a branch to calculate all metrics at tract scale

          2 Simon Krughoff Done
           
          DM-26179

          Convert validation_data_hsc to gen3

          6 Simon Krughoff Done
           
          DM-25978

          Look at how extras are persisted by the butler

          4 Simon Krughoff Done
           
          DM-25837

          Implement stellar locus metric from pipe_analysis

          4 Jeffrey Carlin Done
           
          DM-25838

          Write unit tests for Measurement Tasks

          5 Simon Krughoff Done
           
          DM-25832

          Write unit tests for Measurement Tasks

          2 Simon Krughoff Done
           
          DM-25834

          Propose name for the package

          Leanne Guy Done
           
          DM-26989

          Port metric AM1 to metric task framework

          Jeffrey Carlin Done
           
          DM-26771

          Make the photoCalib and Wcs configurable in the matcher task

          3 Simon Krughoff Done
           
          DM-26663

          Add metadata passing to all base classes and run methods

          2 Jeffrey Carlin Done
           
          DM-26234

          Update metrics depending on spatial separations to work at the tract scale

          4 Jeffrey Carlin Done
           
          DM-27815

          change deepCoadd_skyMap to skyMap in all tasks that use it

          Jeffrey Carlin Done
           
          DM-27628

          Update the metadata produced by the job reporter script

          1 Simon Krughoff Done
           
          DM-26956

          Turn on Gen3 validate_drp in nightly

          2 Simon Krughoff Done
           
          DM-26541

          Refine script for converting validation_data_hsc from gen2 to gen3

          4 Simon Krughoff Done
           
          DM-25508

          Demonstrate scientific parity with validate_drp using new framework on the HSC RC2 dataset

          Keith Bechtol Done
           
          DM-25504

          Port all metrics executed as library functions to new framework

          Keith Bechtol Done
           
          DM-25507

          Tooling to report to SQuaSH

          8 Simon Krughoff Done
           
          DM-25500

          Port metric AF1 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-25503

          Port metric AD2 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-25502

          Port metric AD1 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-25501

          Port metric AF2 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-25499

          Port metric PA2 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-25498

          Port metric PF1 to metric task framework

          1 Jeffrey Carlin Done
           
          DM-24639

          Implement metric AB1 in metric framework

          2 Jeffrey Carlin Done
           
          DM-24626

          Demonstrate metrics pipeline can be run on HSC RC2 dataset

          Jeffrey Carlin Done
           
          DM-25792

          Forward units on to JSON serialization of verify.Job even when NaN

          1 Simon Krughoff Done
           
          DM-25664

          Implement a "summary" aggregation metric measurement

          1 Simon Krughoff Done
           
          DM-25663

          Transition aggregation tasks to operate per tract

          1 Simon Krughoff Done
           
          DM-25511

          Get Gen3 validate_drp running in jenkins

          4 Simon Krughoff Done
           
          DM-25437

          Convert metrics pipeline repository to use eups

          2 Simon Krughoff Done
           
          DM-24625

          Evaluate the lsst.verify.tasks framework for performance metrics

          Simon Krughoff Done
           
          DM-23440

          Evaluate the lsst.verify.tasks framework for performance metrics

          Jeffrey Carlin Done
           
          DM-27042

          Make sure mag errors are being computed correctly

          Simon Krughoff Invalid

            Activity

            There are no comments yet on this issue.

              People

              Assignee:
              lguy Leanne Guy
              Reporter:
              lguy Leanne Guy
              Reviewers:
              Leanne Guy
              Watchers:
              John Parejko, Leanne Guy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Due:
                Created:
                Updated:
                Resolved:
                Start date:

                  Summary Panel