[DM-24624] Development of new package for computing metrics - Jira

XML

Word

Printable

Details

Type: Epic
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: DM Subsystem Science, Validation, Verification
Labels:
None

Epic Name:
sst-svv-metric-framework-development
Team:
DM Science
Cycle:
Spring 2020

Description

Develop a scalable robust framework for computing scientific performance metrics based on the Gen3 middleware. This epic completes when the new framework is at a stage that it can replace validate_drp and validate_drp can be deprecated.

Attachments

Issue Links

blocks

DM-28312 Release faro and add to lsst_distrib

Done

verifies

DM-20307 Design of a verification measurements package

Done

mentioned in: Page Loading...; Page Loading...; Page Loading...; Page Loading...

(1 mentioned in)

Stories in Epic (Custom Issue Matrix)

Key	Summary	Story Points	Assignee	Status
~~DM-27815~~	change deepCoadd_skyMap to skyMap in all tasks that use it		Jeffrey Carlin	Done
~~DM-27135~~	The values for AB1 for r and i band are identical	4	Simon Krughoff	Done
~~DM-26989~~	Port metric AM1 to metric task framework		Jeffrey Carlin	Done
~~DM-26958~~	Fix ADx, AFx calculation to subtract off the median residual	2	Jeffrey Carlin	Done
~~DM-26956~~	Turn on Gen3 validate_drp in nightly	2	Simon Krughoff	Done
~~DM-26234~~	Update metrics depending on spatial separations to work at the tract scale	4	Jeffrey Carlin	Done
~~DM-26663~~	Add metadata passing to all base classes and run methods	2	Jeffrey Carlin	Done
~~DM-26569~~	Create a branch to calculate all metrics at tract scale	2	Simon Krughoff	Done
~~DM-26541~~	Refine script for converting validation_data_hsc from gen2 to gen3	4	Simon Krughoff	Done
~~DM-25511~~	Get Gen3 validate_drp running in jenkins	4	Simon Krughoff	Done
~~DM-25508~~	Demonstrate scientific parity with validate_drp using new framework on the HSC RC2 dataset		Keith Bechtol	Done
~~DM-25507~~	Tooling to report to SQuaSH	8	Simon Krughoff	Done
~~DM-25504~~	Port all metrics executed as library functions to new framework		Keith Bechtol	Done
~~DM-25503~~	Port metric AD2 to metric task framework	1	Jeffrey Carlin	Done
~~DM-25502~~	Port metric AD1 to metric task framework	1	Jeffrey Carlin	Done
~~DM-25501~~	Port metric AF2 to metric task framework	1	Jeffrey Carlin	Done
~~DM-25500~~	Port metric AF1 to metric task framework	1	Jeffrey Carlin	Done
~~DM-25499~~	Port metric PA2 to metric task framework	1	Jeffrey Carlin	Done
~~DM-25498~~	Port metric PF1 to metric task framework	1	Jeffrey Carlin	Done
~~DM-25437~~	Convert metrics pipeline repository to use eups	2	Simon Krughoff	Done
~~DM-25664~~	Implement a "summary" aggregation metric measurement	1	Simon Krughoff	Done
~~DM-25663~~	Transition aggregation tasks to operate per tract	1	Simon Krughoff	Done
~~DM-23440~~	Evaluate the lsst.verify.tasks framework for performance metrics		Jeffrey Carlin	Done
~~DM-27628~~	Update the metadata produced by the job reporter script	1	Simon Krughoff	Done
~~DM-27307~~	Add unit tests for stellar locus metric	2	Jeffrey Carlin	Done
~~DM-26179~~	Convert validation_data_hsc to gen3	6	Simon Krughoff	Done
~~DM-25838~~	Write unit tests for Measurement Tasks	5	Simon Krughoff	Done
~~DM-25792~~	Forward units on to JSON serialization of verify.Job even when NaN	1	Simon Krughoff	Done
~~DM-25837~~	Implement stellar locus metric from pipe_analysis	4	Jeffrey Carlin	Done
~~DM-25834~~	Propose name for the package		Leanne Guy	Done
~~DM-25832~~	Write unit tests for Measurement Tasks	2	Simon Krughoff	Done
~~DM-28235~~	External astrometric calibration not being applied correctly in faro	2	Jeffrey Carlin	Done
~~DM-26771~~	Make the photoCalib and Wcs configurable in the matcher task	3	Simon Krughoff	Done
~~DM-26839~~	Make sure the correct return code is supplied by the gen3 validate_drp scrips	2	Simon Krughoff	Done
~~DM-26837~~	Forward both abstract and physical filter names to SQuaSH	1	Simon Krughoff	Done
~~DM-26877~~	Fix metric_pipeline_tasks to use band instead abstract_filter	1	Simon Krughoff	Done
~~DM-25978~~	Look at how extras are persisted by the butler	4	Simon Krughoff	Done
~~DM-24639~~	Implement metric AB1 in metric framework	2	Jeffrey Carlin	Done
~~DM-24626~~	Demonstrate metrics pipeline can be run on HSC RC2 dataset		Jeffrey Carlin	Done
~~DM-24625~~	Evaluate the lsst.verify.tasks framework for performance metrics		Simon Krughoff	Done
~~DM-27042~~	Make sure mag errors are being computed correctly		Simon Krughoff	Invalid

Activity

There are no comments yet on this issue.

People

Assignee:: Leanne Guy

Reporter:: Leanne Guy

Reviewers:: Leanne Guy

Watchers:: John Parejko, Leanne Guy

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Due:: 31/Jul/20

Created:: 27/Apr/20 10:20 PM

Updated:: 26/Mar/21 6:18 PM

Resolved:: 14/Jan/21 11:07 PM

Start date:: 03/Feb/20

Jenkins

No builds found.

Data Management