# Jacobian lost in meas_mosaic photometric solution

XMLWordPrintable

#### Details

• Type: Story
• Status: Done
• Resolution: Done
• Fix Version/s: None
• Component/s:
• Labels:
• Story Points:
1
• Sprint:
AP S19-5
• Team:

#### Description

It looks like we lost the Jacobian from the meas_mosaic photometric solution with this deletion from DM-10156:
I noticed this in comparing meas_mosaic-calibrated magnitudes between the w_2019_10 and w_2019_14 RC2 reprocessings, which look like:

#### Activity

Hide
Lauren MacArthur added a comment - - edited

Ok, using your ticket branch, I ran:

 mosaic.py /datasets/hsc/repo --rerun RC/w_2019_14/DM-18300-sfm:private/lauren/DM-19265 --numCoresForRead=12 --diagnostics --diagDir=/scratch/lauren/DM-19265/mosaicDiag/ --id tract=9813 ccd=0..8^10..103 visit=1228..1232:2^1238..1248:2^19658..19662:2^19680..19684:2^19694..19698:2^19708..19712:2^30482..30504:2 filter=HSC-I 

The following is the comparison of this output to that of the w_2019_10 RC2 run for visit 1228 (meas_mosaic calibrations being applied here):

So the good news is that the Jacobian is back Puzzling, though, is that there is still some difference between this branch and the w_2019_10 RC2 run. In fact, this difference also exists (in spirit) for the w14 vs w10 jointcal calibrations:

Comparing w10 to w06 meas_mosaic looks like:

which again show similar – but not identical – differences. Here is the same comparison but between the w10 vs w06 jointcal calibrations:

So it seems there have been some subtle changes from weekly06-to-weekly10-to-weekly14 that slightly affect the uberCal results. I had a glance at the weekly changelogs and nothing in particular jumped out at me. Any ideas? If this is expected, then no further digging is required...otherwise we may need to figure out the source of these differences (however small?).

Show
Lauren MacArthur added a comment - - edited Ok, using your ticket branch, I ran: mosaic.py / datasets / hsc / repo - - rerun RC / w_2019_14 / DM - 18300 - sfm:private / lauren / DM - 19265 - - numCoresForRead = 12 - - diagnostics - - diagDir = / scratch / lauren / DM - 19265 / mosaicDiag / - - id tract = 9813 ccd = 0. . 8 ^ 10. . 103 visit = 1228. . 1232 : 2 ^ 1238. . 1248 : 2 ^ 19658. . 19662 : 2 ^ 19680. . 19684 : 2 ^ 19694. . 19698 : 2 ^ 19708. . 19712 : 2 ^ 30482. . 30504 : 2 filter = HSC - I The following is the comparison of this output to that of the w_2019_10 RC2 run for visit 1228 ( meas_mosaic calibrations being applied here): So the good news is that the Jacobian is back Puzzling, though, is that there is still some difference between this branch and the  w_2019_10 RC2 run. In fact, this difference also exists (in spirit) for the w14 vs w10 jointcal calibrations: Comparing w10 to w06 meas_mosaic looks like: which again show similar – but not identical – differences. Here is the same comparison but between the w10 vs w06 jointcal calibrations: So it seems there have been some subtle changes from weekly06-to-weekly10-to-weekly14 that slightly affect the uberCal results. I had a glance at the weekly changelogs and nothing in particular jumped out at me. Any ideas? If this is expected, then no further digging is required...otherwise we may need to figure out the source of these differences (however small?).
Hide
Robert Lupton added a comment -

Are the raw Gaussian mags identical?

Show
Robert Lupton added a comment - Are the raw Gaussian mags identical?
Hide
Lauren MacArthur added a comment - - edited

Yes:

Show
Lauren MacArthur added a comment - - edited Yes:
Hide
Lauren MacArthur added a comment -

Seeing as these residual differences are likely unrelated to this issue, I think you’re good to merge this fix.  I’ll file a ticket to look into the cause of said differences.

Show
Lauren MacArthur added a comment - Seeing as these residual differences are likely unrelated to this issue, I think you’re good to merge this fix.  I’ll file a ticket to look into the cause of said differences.
Hide
John Parejko added a comment -

Thanks: yes, lets deal with each bit separately.

Merged and done.

Show
John Parejko added a comment - Thanks: yes, lets deal with each bit separately. Merged and done.

#### People

Assignee:
John Parejko
Reporter:
Lauren MacArthur
Reviewers:
Lauren MacArthur
Watchers:
Jim Bosch, John Parejko, Lauren MacArthur, Robert Lupton, Yusra AlSayyad