[DM-11783] Replace meas_mosaic with Jointcal - Jira

XML

Word

Printable

Details

Type: Epic
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: jointcal, meas_mosaic
Labels:
- SciencePipelines

Epic Name:
s18-ap-jointcal-mosaic
Story Points:
52
WBS:
02C.03.07
Team:
Alert Production
Cycle:
Spring 2018

Description

This epic is for the work required to determine if we are ready to replace meas_mosaic with jointcal. The test plan is described in ~~DM-10730~~, and will require that jointcal's output be able to be run through validate_drp.

The length of this epic depends in part on whether changes to jointcal-to improve its models, etc.-are necessary after the first comparison is done.

Attachments

Issue Links

is blocked by

DM-12796 jointcal butler templates don't include filter

Invalid

DM-11571 Complete and test use of jointcal results in validate_drp

Done

DM-11800 Update meas_mosaic to new transform-based API for afw::cameraGeom

Done

DM-10730 Near-term jointcal acceptance: write test description

Done

relates to

DM-15241 log error when final chi2 is large

Done

DM-15221 parallelize validate_drp ingest

Won't Fix

Wiki Page: Wiki Page Loading...

(1 relates to, 1 Wiki Page)

Stories in Epic (Custom Issue Matrix)

Key	Summary	Story Points	Assignee	Status
~~DM-15431~~	Add Jacobian BoundedField accessor to SkyWcs	6	John Parejko	Done
~~DM-15421~~	Change to use constrained models by default	1	John Parejko	Done
~~DM-15254~~	Option to normalize warps by Jointcal's PhotoCalib	8	John Parejko	Done
~~DM-15241~~	log error when final chi2 is large	0.5	John Parejko	Done
~~DM-15011~~	implement separate Visit and Chip fitting for photometry	2	John Parejko	Done
~~DM-13272~~	Confirm jointcal's astrometry output	16	John Parejko	Done
~~DM-13269~~	Improve jointcal debugging output	8	John Parejko	Done
~~DM-13187~~	jointcal selected_*_refStars is not correctly computed	2	John Parejko	Done
~~DM-11571~~	Complete and test use of jointcal results in validate_drp	4	John Parejko	Done
~~DM-11787~~	First comparison of jointcal/meas_mosaic in validate_drp	4	John Parejko	Done
~~DM-11785~~	Run jointcal on acceptance data	8	John Parejko	Done
~~DM-11784~~	Find all the necessary data for jointcal/meas_mosaic comparison	1	John Parejko	Done
~~DM-16235~~	Jointcal PhotoCalib returns negative calibrations	8	John Parejko	Done
~~DM-15713~~	Run jointcal comparison with higher order polynomial	1	John Parejko	Done
~~DM-15695~~	Measure jointcal acceptance statistics	2	John Parejko	Done
~~DM-15617~~	Process HSC PDR1 data with Jointcal as of 2018-08-31.	2	John Parejko	Done
~~DM-15751~~	Configure ability to build coadds with either Jointcal or meas_mosaic	2	John Parejko	Done
~~DM-12918~~	investigate and merge u/fix_outliers	4	John Parejko	Done
~~DM-12906~~	Generate summary tables for jointcal/meas_mosaic comparison	4	John Parejko	Done
~~DM-14612~~	Fix race condition in new jointcal matrix dump test	0.5	John Parejko	Done
~~DM-14574~~	implement magnitude-based photometric model	6	John Parejko	Done
~~DM-14786~~	Implement ConstrainedMagnitude model	10	John Parejko	Done
~~DM-11931~~	Fix jointcal exit status and doRaise handling	2	John Parejko	Done
~~DM-12029~~	recompress jointcal's testdata zeroed images with fpack	2	John Parejko	Done
~~DM-14510~~	Implement line search	8	John Parejko	Done
~~DM-12254~~	Switch jointcal to default to IndexedRefObj instead of a.net	1	John Parejko	Done
~~DM-12310~~	Figure out why most HSC datasets start with photometry chi2==NaN	4	John Parejko	Done
~~DM-13674~~	Save full astrometry model as astShim.FrameDict	6	John Parejko	Done
~~DM-13671~~	Add option to skip cholmod.update step	4	John Parejko	Done
~~DM-13670~~	Check residual vs. errors for photometry	6	John Parejko	Done
~~DM-13669~~	Track and log measurement/reference outliers separately	2	John Parejko	Done
~~DM-13575~~	fix minor bug in photometry ipynb	0.5	John Parejko	Done
~~DM-14020~~	Allow inclusion of astrometric jacobian in photoCalib		John Parejko	Invalid
~~DM-14767~~	fix photometric error calculation	4	John Parejko	Invalid

Activity

Ascending order - Click to sort in descending order

John Parejko created issue - 01/Sep/17 1:21 PM

John Parejko made changes - 01/Sep/17 1:21 PM

Field	Original Value	New Value
Link		This issue is blocked by ~~DM-11571~~ [ ~~DM-11571~~ ]

John Parejko made changes - 01/Sep/17 1:21 PM

Link

This issue is blocked by ~~DM-10730~~ [ ~~DM-10730~~ ]

John Parejko made changes - 01/Sep/17 1:21 PM

Description

This epic is for the work required to determine if we are ready to replace {{meas_mosaic}} with {{jointcal}}. The test plan is described in ~~DM-10730~~, and will require that jointcal's output be able to be run through {{validate_drp}}.

The length of this epic depends in part on whether changes to jointcal--to improve its models, etc.--are necessary after the first comparison is done.

This epic is for the work required to determine if we are ready to replace {{meas_mosaic}} with {{jointcal}}. The test plan is described in ~~DM-10730~~, and will require that jointcal's output be able to be run through {{validate_drp}}.

The length of this epic depends in part on whether changes to jointcal-to improve its models, etc.-are necessary after the first comparison is done.

John Parejko made changes - 01/Sep/17 1:26 PM

Epic Child

~~DM-11784~~ [ 34261 ]

John Parejko made changes - 01/Sep/17 1:27 PM

Epic Child

~~DM-11785~~ [ 34262 ]

John Parejko made changes - 01/Sep/17 1:28 PM

Epic Child

~~DM-11786~~ [ 34263 ]

John Parejko made changes - 01/Sep/17 1:30 PM

Epic Child

~~DM-11787~~ [ 34264 ]

Tim Jenness made changes - 06/Sep/17 9:55 AM

Link

This issue is blocked by ~~DM-11800~~ [ ~~DM-11800~~ ]

John Swinbank made changes - 07/Sep/17 5:51 PM

Epic Child

~~DM-11571~~ [ 33887 ]

John Parejko made changes - 17/Oct/17 11:58 AM

Status

To Do [ 10001 ]

In Progress [ 3 ]

John Parejko made changes - 17/Oct/17 2:30 PM

Epic Child

~~DM-12254~~ [ 35303 ]

John Parejko made changes - 18/Oct/17 12:16 AM

Epic Child

~~DM-12029~~ [ 34649 ]

John Swinbank made changes - 19/Oct/17 11:26 AM

Epic Name

jointcal/meas_mosiac comparison

f17-ap-jointcal-mosaic

John Swinbank made changes - 20/Oct/17 7:25 AM

Epic Child

~~DM-12310~~ [ 35373 ]

John Swinbank made changes - 20/Oct/17 10:40 AM

Epic Child

~~DM-12313~~ [ 35377 ]

John Swinbank made changes - 24/Oct/17 6:04 PM

Epic Child

~~DM-11931~~ [ 34491 ]

John Parejko made changes - 30/Oct/17 2:38 PM

Epic Child

~~DM-12313~~ [ 35377 ]

John Parejko made changes - 21/Nov/17 4:35 PM

Link

This issue is blocked by ~~DM-12796~~ [ ~~DM-12796~~ ]

John Swinbank made changes - 29/Nov/17 10:46 AM

WBS

02C.03.05

John Swinbank made changes - 29/Nov/17 6:49 PM

Summary

Compare results of jointcal and meas_mosaic on HSC

Replace meas_mosaic with Jointcal

John Swinbank made changes - 29/Nov/17 6:49 PM

Epic Name

f17-ap-jointcal-mosaic

f18-ap-jointcal-mosaic

John Swinbank made changes - 30/Nov/17 5:51 PM

Epic Name

f18-ap-jointcal-mosaic

fs8-ap-jointcal-mosaic

John Swinbank made changes - 30/Nov/17 5:51 PM

Epic Name

fs8-ap-jointcal-mosaic

s18-ap-jointcal-mosaic

John Swinbank made changes - 30/Nov/17 5:51 PM

WBS

02C.03.05

02C.03.07

John Swinbank made changes - 30/Nov/17 6:25 PM

Cycle

Spring 2018 [ 10806 ]

John Swinbank made changes - 30/Nov/17 6:25 PM

Story Points

John Parejko made changes - 01/Dec/17 2:47 PM

Epic Child

~~DM-12906~~ [ 36633 ]

John Swinbank made changes - 04/Dec/17 4:28 PM

Epic Child

~~DM-12653~~ [ 36223 ]

John Parejko made changes - 04/Dec/17 4:36 PM

Epic Child

~~DM-12918~~ [ 36661 ]

John Swinbank made changes - 11/Dec/17 1:25 PM

Epic Child

~~DM-12653~~ [ 36223 ]

John Parejko made changes - 15/Dec/17 6:50 PM

Epic Child

~~DM-13053~~ [ 36993 ]

John Parejko made changes - 15/Dec/17 6:53 PM

Epic Child

~~DM-13054~~ [ 36994 ]

John Swinbank made changes - 15/Jan/18 1:14 PM

Epic Child

~~DM-13187~~ [ 37709 ]

John Swinbank made changes - 16/Jan/18 3:55 PM

Epic Child

~~DM-13202~~ [ 37743 ]

John Swinbank made changes - 16/Jan/18 9:59 PM

Epic Child

~~DM-11786~~ [ 34263 ]

John Parejko made changes - 18/Jan/18 5:14 PM

Epic Child

~~DM-13269~~ [ 38126 ]

John Parejko made changes - 18/Jan/18 5:25 PM

Epic Child

~~DM-13270~~ [ 38127 ]

John Parejko made changes - 18/Jan/18 7:23 PM

Epic Child

~~DM-13272~~ [ 38130 ]

John Swinbank made changes - 13/Mar/18 2:22 PM

Epic Child

~~DM-13575~~ [ 38870 ]

John Swinbank made changes - 05/Apr/18 9:26 AM

Epic Child

~~DM-13671~~ [ 39042 ]

John Swinbank made changes - 05/Apr/18 9:26 AM

Epic Child

~~DM-13670~~ [ 39041 ]

John Swinbank made changes - 06/Apr/18 9:44 AM

Epic Child

~~DM-14020~~ [ 39883 ]

John Swinbank made changes - 18/Apr/18 10:17 AM

Epic Child

~~DM-13669~~ [ 39040 ]

John Swinbank made changes - 18/Apr/18 10:17 AM

Epic Child

~~DM-13674~~ [ 39048 ]

John Swinbank made changes - 18/May/18 5:38 PM

Epic Child

~~DM-14511~~ [ 85856 ]

John Swinbank made changes - 20/May/18 10:46 AM

Epic Child

~~DM-14439~~ [ 80206 ]

John Swinbank made changes - 25/May/18 10:21 AM

Epic Child

~~DM-14574~~ [ 95055 ]

John Swinbank made changes - 31/May/18 9:41 AM

Epic Child

~~DM-14612~~ [ 103310 ]

John Swinbank made changes - 12/Jun/18 3:31 PM

Epic Child

~~DM-14767~~ [ 120025 ]

John Swinbank made changes - 05/Jul/18 11:27 AM

Epic Child

~~DM-15011~~ [ 140664 ]

John Parejko made changes - 26/Jul/18 2:25 PM

Link

This issue relates to ~~DM-15221~~ [ ~~DM-15221~~ ]

John Swinbank made changes - 30/Jul/18 8:51 AM

Epic Child

~~DM-13202~~ [ 37743 ]

John Parejko made changes - 30/Jul/18 5:00 PM

Link

This issue relates to ~~DM-15241~~ [ ~~DM-15241~~ ]

John Swinbank made changes - 03/Aug/18 2:17 PM

Epic Child

~~DM-14510~~ [ 85847 ]

John Swinbank made changes - 06/Aug/18 2:40 PM

Epic Child

~~DM-15241~~ [ 159857 ]

John Swinbank made changes - 06/Aug/18 3:08 PM

Epic Child

~~DM-14511~~ [ 85856 ]

John Swinbank made changes - 06/Aug/18 3:09 PM

Epic Child

~~DM-14439~~ [ 80206 ]

John Swinbank made changes - 06/Aug/18 3:10 PM

Epic Child

~~DM-13270~~ [ 38127 ]

John Swinbank made changes - 31/Aug/18 1:18 PM

Epic Child

~~DM-15617~~ [ 189233 ]

John Swinbank made changes - 31/Aug/18 1:33 PM

Epic Child

~~DM-14786~~ [ 122109 ]

John Swinbank made changes - 06/Sep/18 9:20 AM

Epic Child

~~DM-13053~~ [ 36993 ]

John Swinbank made changes - 06/Sep/18 9:23 AM

Epic Child

~~DM-15254~~ [ 160949 ]

John Swinbank made changes - 06/Sep/18 9:23 AM

Epic Child

~~DM-15431~~ [ 172209 ]

John Swinbank made changes - 10/Sep/18 2:44 PM

Epic Child

~~DM-15421~~ [ 171254 ]

John Parejko made changes - 14/Sep/18 2:34 PM

Epic Child

DM-15762 [ 202063 ]

John Swinbank made changes - 18/Sep/18 2:38 PM

Epic Child

~~DM-15544~~ [ 184311 ]

John Swinbank made changes - 24/Sep/18 11:03 AM

Epic Child

~~DM-15695~~ [ 198375 ]

John Swinbank made changes - 24/Sep/18 11:04 AM

Epic Child

~~DM-15713~~ [ 198776 ]

John Swinbank made changes - 24/Sep/18 11:14 AM

Epic Child

~~DM-15606~~ [ 188002 ]

John Parejko made changes - 24/Sep/18 11:14 AM

Epic Child

~~DM-15606~~ [ 188002 ]

John Swinbank made changes - 24/Sep/18 11:17 AM

Epic Child

~~DM-15606~~ [ 188002 ]

John Swinbank made changes - 24/Sep/18 11:22 AM

Epic Child

~~DM-15544~~ [ 184311 ]

John Swinbank made changes - 24/Sep/18 11:30 AM

Epic Child

DM-15846 [ 212476 ]

Yusra AlSayyad made changes - 28/Sep/18 2:21 PM

Epic Child

~~DM-15606~~ [ 188002 ]

John Parejko made changes - 17/Oct/18 2:35 PM

Epic Child

~~DM-16235~~ [ 229509 ]

John Swinbank made changes - 30/Oct/18 12:18 PM

Epic Child

DM-15762 [ 202063 ]

John Swinbank made changes - 31/Oct/18 8:50 AM

Epic Child

~~DM-15751~~ [ 201830 ]

Gabriele Comoretto [X] (Inactive) made changes - 31/Oct/18 5:01 PM

Link

This issue blocks ~~DM-16397~~ [ ~~DM-16397~~ ]

John Swinbank made changes - 21/Nov/18 5:12 PM

Epic Child

~~DM-13054~~ [ 36994 ]

John Swinbank made changes - 29/Nov/18 7:30 AM

Link

This issue blocks ~~DM-16397~~ [ ~~DM-16397~~ ]

John Swinbank made changes - 29/Nov/18 7:35 AM

Epic Child

DM-15846 [ 212476 ]

John Swinbank made changes - 29/Nov/18 7:35 AM

Resolution		Done [ 10000 ]
Status	In Progress [ 3 ]	Done [ 10002 ]

Tim Jenness made changes - 11/Mar/19 7:37 AM

Remote Link

This issue links to "Wiki Page (Confluence)" [ 20020 ]

People

Assignee:: John Parejko

Reporter:: John Parejko

Watchers:: Hsin-Fang Chiang, Jim Bosch, John Parejko, John Swinbank, Lauren MacArthur, Michael Wood-Vasey, Pierre Astier, Simon Krughoff

Votes:: 0 Vote for this issue

Watchers:: 8 Start watching this issue

Dates

Created:: 01/Sep/17 1:21 PM

Updated:: 11/Mar/19 7:37 AM

Resolved:: 29/Nov/18 7:35 AM

Jenkins

No builds found.

Data Management

Details

Description

Attachments

Issue Links

Stories in Epic (Custom Issue Matrix)

Activity

People

Dates

Jenkins