Details
-
Type:
Epic
-
Status: In Progress
-
Resolution: Unresolved
-
Fix Version/s: None
-
Component/s: Data Release Production, DM Subsystem Science, QA
-
Epic Name:sst-dpdd-qa-reconciliation
-
Story Points:20
-
Team:DM Science
-
Cycle:Spring 2020
Description
As discussed at DMLT F2F 2019-10-28, work is needed to reconcile the outputs of the pipeline processing with what is specified in the DPDD. Pipelines developers need to output many more quantities from the processing, primarily for QA purposes, than are specified in the DPDD. Not all of these quantities will necessarily be interesting for science.
A possible approach is to add more information, not currently specified in the DPDD, to the tables, or, to put some of the QA quantities in a separate table that can be joined with. The DPDD is regarded as a minimum, but note that changes have impacts on the sizing model.
This epic captures tickets for changes to the DPDD to reconcile the outputs of the pipeline processing with the DPDD
Attachments
Issue Links
| Key | Summary | Story Points | Assignee | Status | |
|---|---|---|---|---|---|
| DM-22251 | Unassigned | To Do | |||
| DM-22250 | Unassigned | To Do | |||
| DM-22249 | Unassigned | To Do | |||
| DM-22248 | Unassigned | To Do | |||
| DM-22247 | Unassigned | To Do | |||
| DM-22246 | Object Table: Change Aperture Surface Brightness to Fluxes in DPDD |
Unassigned | To Do | ||
| DM-22245 | Unassigned | To Do | |||
| DM-22244 | Unassigned | To Do | |||
| DM-22243 | Object Table: Replace <color>Std with blessed fluxes for galaxy colors |
Unassigned | To Do | ||
| DM-22242 | Unassigned | To Do | |||
| DM-22241 | Unassigned | To Do | |||
| DM-6366 | Jim Bosch | To Do |
Activity
I would interpret it as an evaluation of the background model, not the measurement after background-subtraction.
Colin Slater
added a comment - I would interpret it as an evaluation of the background model, not the measurement after background-subtraction.
Re: DPDD columns, the DPDD currently says this about the sky column in the Data Release Catalog Source Table: “Estimated background (sky) surface brightness at the position (centroid) of the source” with units nJy/arcsec^2. What does this mean? Right now, in https://github.com/lsst/obs_subaru/blob/master/policy/Source.yaml this is defined as base_LocalBackground_instFlux which is the local background in the calexp (which has been sky/background subtracted!) measured in a somewhat arbitrary annulus around the source. But I’m wondering if instead this is supposed to be an estimate of the full sky/background from the calexpBackground at the location of the source? As far as I can tell, this isn’t actually specified anywhere in the DPDD.