[DM-22277] Convert TransformObjectTableTask and friends to Gen 3 - Jira

XML

Word

Printable

Details

Type: Story
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: None
Labels:
- drp-parity
- w_2021_14

Story Points:
2
Epic Link:
s21b-a&p-preops
Sprint:
DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July), DRP F20-3 (Aug), DRP F20-5 (Oct), DRP S21a (Dec Jan)
Team:
Data Release Production
Urgent?:
No

Attachments

Issue Links

mentioned in: Page Loading...

Activity

Ascending order - Click to sort in descending order

No builds found.

Yusra AlSayyad created issue - 19/Nov/19 11:30 PM

Yusra AlSayyad made changes - 19/Nov/19 11:33 PM

Field	Original Value	New Value
Status	To Do [ 10001 ]	In Progress [ 3 ]

Yusra AlSayyad made changes - 13/Jan/20 3:48 PM

Sprint

DRP F19-6 (Nov) [ 972 ]

DRP F19-6 (Nov), DRP S20-2 (Jan) [ 972, 998 ]

Yusra AlSayyad made changes - 03/Feb/20 12:08 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan) [ 972, 998 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb) [ 972, 998, 1000 ]

Yusra AlSayyad made changes - 03/Apr/20 5:40 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb) [ 972, 998, 1000 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr) [ 972, 998, 1000, 1014 ]

Yusra AlSayyad made changes - 01/May/20 8:49 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr) [ 972, 998, 1000, 1014 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May) [ 972, 998, 1000, 1014, 1021 ]

Yusra AlSayyad made changes - 12/Jun/20 4:14 AM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May) [ 972, 998, 1000, 1014, 1021 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June) [ 972, 998, 1000, 1014, 1021, 1030 ]

Yusra AlSayyad made changes - 15/Jul/20 4:28 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June) [ 972, 998, 1000, 1014, 1021, 1030 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July) [ 972, 998, 1000, 1014, 1021, 1030, 1036 ]

Yusra AlSayyad made changes - 03/Aug/20 9:56 PM

Epic Link

PREOPS-93 [ 438318 ]

Yusra AlSayyad made changes - 03/Aug/20 9:56 PM

Urgent?

off

Yusra AlSayyad made changes - 07/Aug/20 7:06 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July) [ 972, 998, 1000, 1014, 1021, 1030, 1036 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July), DRP F20-3 (Aug) [ 972, 998, 1000, 1014, 1021, 1030, 1036, 1042 ]

Yusra AlSayyad made changes - 28/Sep/20 3:52 PM

Remote Link

This issue links to "Page (Confluence)" [ 25988 ]

Yusra AlSayyad made changes - 07/Oct/20 3:20 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July), DRP F20-3 (Aug) [ 972, 998, 1000, 1014, 1021, 1030, 1036, 1042 ]

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July), DRP F20-3 (Aug), DRP F20-5 (Oct) [ 972, 998, 1000, 1014, 1021, 1030, 1036, 1042, 1054 ]

Yusra AlSayyad made changes - 16/Dec/20 4:20 AM

Epic Link

PREOPS-93 [ 438318 ]

PREOPS-281 [ 442892 ]

Yusra AlSayyad made changes - 18/Dec/20 8:36 PM

Sprint

DRP F19-6 (Nov), DRP S20-2 (Jan), DRP S20-3 (Feb), DRP S20-5 (Apr), DRP S20-6 (May), DRP F20-1 (June), DRP F20-2 (July), DRP F20-3 (Aug), DRP F20-5 (Oct), DRP S21 (Dec Jan) [ 972, 998, 1000, 1014, 1021, 1030, 1036, 1042, 1054, 1071 ]

Yusra AlSayyad made changes - 04/Mar/21 6:24 PM

Remote Link

This issue links to "Page (Confluence)" [ 27759 ]

Yusra AlSayyad made changes - 04/Mar/21 11:47 PM

Labels

drp-parity w_2020_14

Yusra AlSayyad made changes - 04/Mar/21 11:50 PM

Remote Link

This issue links to "Page (Confluence)" [ 27759 ]

Yusra AlSayyad made changes - 04/Mar/21 11:53 PM

Reviewers		Eli Rykoff [ erykoff ]
Status	In Progress [ 3 ]	In Review [ 10004 ]

Yusra AlSayyad made changes - 04/Mar/21 11:53 PM

Status

In Review [ 10004 ]

In Progress [ 3 ]

Yusra AlSayyad made changes - 04/Mar/21 11:53 PM

Comment

[ Since this is causing you pain, want to review? :) (Not today)
Jenkins running: https://ci.lsst.codes/job/stack-os-matrix/33744/display/redirect ]

Yusra AlSayyad made changes - 04/Mar/21 11:59 PM

Labels

drp-parity w_2020_14

drp-parity w_2021_14

Yusra AlSayyad made changes - 26/Mar/21 12:12 AM

Epic Link

PREOPS-281 [ 442892 ]

PREOPS-450 [ 463950 ]

Hide

Permalink

Yusra AlSayyad added a comment - 31/Mar/21 7:33 AM - edited

Ready for review.
These tasks are run in ci_hsc. Jenkins working here: https://ci.lsst.codes/job/stack-os-matrix/33916/display/redirect

Will compare the Gen2 and Gen3 file contents from ci_hsc tomorrow. We don't necessarily expect these to work on older converted repos. Bands are different in the older repos (These tasks run on older converted repos, but contents are NaN because of the bands) and patch numbers are strings->ints.

Gen3 objectTables will have one more column: 'skymap'.

Show

Yusra AlSayyad added a comment - 31/Mar/21 7:33 AM - edited Ready for review. These tasks are run in ci_hsc . Jenkins working here: https://ci.lsst.codes/job/stack-os-matrix/33916/display/redirect Will compare the Gen2 and Gen3 file contents from ci_hsc tomorrow. We don't necessarily expect these to work on older converted repos. Bands are different in the older repos (These tasks run on older converted repos, but contents are NaN because of the bands) and patch numbers are strings->ints. Gen3 objectTables will have one more column: 'skymap'.

Yusra AlSayyad made changes - 31/Mar/21 9:27 PM

Status

In Progress [ 3 ]

In Review [ 10004 ]

Eli Rykoff made changes - 31/Mar/21 9:29 PM

Status

In Review [ 10004 ]

Reviewed [ 10101 ]

Hide

Permalink

Yusra AlSayyad added a comment - 01/Apr/21 2:29 AM

OK, made the 2 fixes you requested and checked the outputs.

I'm glad I decided to try to get this ticket in before w14, because we haven't had colors in our object tables since the filter to band migration (in either Gen2 or Gen3). I opened a new PR for obs_subaru specifying the filters as 'r' rather than 'HSC-R'. This works in both Gen2 and Gen3. Also fixed the NaN reference columns ci_hsc where we only have 'r' and 'i'.

New Jenkins working here: https://ci.lsst.codes/job/stack-os-matrix/33933/display/redirect

Show

Yusra AlSayyad added a comment - 01/Apr/21 2:29 AM OK, made the 2 fixes you requested and checked the outputs. I'm glad I decided to try to get this ticket in before w14, because we haven't had colors in our object tables since the filter to band migration (in either Gen2 or Gen3). I opened a new PR for obs_subaru specifying the filters as 'r' rather than 'HSC-R'. This works in both Gen2 and Gen3. Also fixed the NaN reference columns ci_hsc where we only have 'r' and 'i'. New Jenkins working here: https://ci.lsst.codes/job/stack-os-matrix/33933/display/redirect

Yusra AlSayyad made changes - 01/Apr/21 6:58 AM

Resolution		Done [ 10000 ]
Status	Reviewed [ 10101 ]	Done [ 10002 ]

People

Assignee:: Yusra AlSayyad

Reporter:: Yusra AlSayyad

Reviewers:: Eli Rykoff

Watchers:: Eli Rykoff, Hsin-Fang Chiang, Yusra AlSayyad

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 19/Nov/19 11:30 PM

Updated:: 01/Apr/21 6:58 AM

Resolved:: 01/Apr/21 6:58 AM

Jenkins

No builds found.

Data Management

Details

Attachments

Issue Links

Activity

People

Dates

Jenkins