# Update LSST full-stack processing configuration to match best practice from HSC

XMLWordPrintable

#### Details

• Type: Story
• Status: Done
• Resolution: Done
• Fix Version/s: None
• Component/s: None
• Labels:
None
• Story Points:
10
• Sprint:
DRP F16-2, DRP F16-3, DRP F16-4
• Team:
Data Release Production

#### Description

In preparation for running an end-to-end comparison of large scale processing with the HSC and LSST stacks, we need to update the configuration to reflect currently understood best practice.

In general, we expect the default HSC configuration to be better understood and "battle-tested" given that it has been used for science-grade data releases.

Audit the default configuration of the full LSST stack (from ProcessCcdTask through multiband coadd processing). Where LSST defaults differ from HSC, update the LSST configuration to match the HSC equivalent unless there's a clear reason why LSST's default should be different. When it's not appropriate to update the LSST configuration, add an override to obs_subaru.

In some cases, the LSST and HSC stacks have diverged so that a direct transfer of configuration options isn't possible. Where an equivalent can be found, take advantage of it. Otherwise, stick with existing LSST defaults.

#### Attachments

1. demoJunkSuppression.png
30 kB
2. demoPsfFlux.png
15 kB
3. demoSpatialStructure.png
212 kB
4. demoSpatialStructure2.png
75 kB
5. demoSpatialStructureUseApprox.png
79 kB

#### Activity

Hide
Lauren MacArthur added a comment -

Robert Lupton, quick update: having now set useApprox=True the apparent gradient is gone. Deep interpretation of any differences is difficult as the demo previously ran with no junk suppression and performing background estimation via interpolation.

Show
Lauren MacArthur added a comment - Robert Lupton , quick update: having now set useApprox=True the apparent gradient is gone. Deep interpretation of any differences is difficult as the demo previously ran with no junk suppression and performing background estimation via interpolation.
Hide
Paul Price added a comment -

I'm concerned about making applyUberCal=True the default because it will break cameras for which jointcal or meas_mosaic isn't working.

Show
Paul Price added a comment - Some comments on GitHub PRs. I'm concerned about making applyUberCal=True the default because it will break cameras for which jointcal or meas_mosaic isn't working.
Hide
Lauren MacArthur added a comment -

Paul Price: I've updated to keep applyUberCal=False as the codebase default, but am overriding it to True in obs_subaru by default for HSC coaddition. Also, because the QA analysis script makes use of the extendedness value in the forced coadd results, I've added the following to config/forcedPhotCoadd.py:

 config.catalogCalculation.plugins.names=["base_ClassificationExtendedness"] 

Are you ok with these changes?

Show
Lauren MacArthur added a comment - Paul Price : I've updated to keep applyUberCal=False as the codebase default, but am overriding it to True in obs_subaru by default for HSC coaddition. Also, because the QA analysis script makes use of the extendedness value in the forced coadd results, I've added the following to config/forcedPhotCoadd.py : config.catalogCalculation.plugins.names=["base_ClassificationExtendedness"] Are you ok with these changes?
Hide
Paul Price added a comment -

Yes, thanks!

Show
Paul Price added a comment - Yes, thanks!
Hide
Lauren MacArthur added a comment -

Thanks to everyone for all of the input on this one.

Merged to master.

Show
Lauren MacArthur added a comment - Thanks to everyone for all of the input on this one. Merged to master.

#### People

Assignee:
Lauren MacArthur
Reporter:
John Swinbank
Reviewers:
Paul Price
Watchers:
Bob Armstrong, Jim Bosch, John Swinbank, Lauren MacArthur, Paul Price, Robert Lupton