Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-876

Modify requirements on intermediate data products in LSE-61 and DPDD

    XMLWordPrintable

    Details

      Description

      The DM-SST reviewed DMS-REQ-0277 and decided we should not place requirements on intermediate data products that will not be persisted (and consequently burden ourselves with having to verify them). The corresponding OSS requirement from which this requirement is flowed down, OSS-REQ-0137, places no higher level requirement that necessitates a DM requirement on a DM intermediate data product. 

      DMS-REQ-0277:  Coadd Source Catalog

      Specification: The DMS shall, in the course of creating the master Source Catalog, create a
      catalog from the coadds of all sources detected in each passband with a SNR > coaddDetectThresh.

      Discussion: CoaddSources are in general composites of overlapping astrophysical objects. This catalog is an intermediate product in DR production, and will not be permanently archived nor released to end-users.

      I hence propose we remove DMS-REQ-0277 from the DMSR.  There are knock-on effects to other requirements: DMS-REQ-0275 and DMS-REQ-0267.

      ------------------------------------------------------------------

      Exact proposed changes to the DMSR:

      1.4.14 Coadd Source Catalog ID: DMS-REQ-0277 (Priority: 1b)
      Specification: The DMS shall, in the course of creating the master Source Catalog, create a catalog from the coadds of all sources detected in each passband with a SNR > coaddDetectThresh.

      Discussion: CoaddSources are in general composites of overlapping astrophysical objects. This catalog is an intermediate product in DR production, and will not be permanently archived nor released to end-users. 

      Proposed Change: Delete (deprecate) this requirement. We should not constrain ourselves by putting requirements on intermediate data products. Additionally, "CoaddSources" is not a data product that is part of the current design nor is planned.  Recent work on multiband detection suggests that this strategy is not likely to be adopted.

      1.4.2 Object Catalog ID: DMS-REQ-0275 (Priority: 1b)
      Specification: The DMS shall create an Object Catalog, based on sources deblended based on knowledge of CoaddSource, DIASource, DIAObject, and SSObject Catalogs, after multi-epoch spatial association and characterization. 

      New proposed Specification: The DMS shall create an Object Catalog, based on deblended sources detected in coadds and knowledge of DIASource, DIAObject and SSObject Catalogs, after multi-epoch spatial association and characterization.

      ------------------------------------------------------------------

      Exact proposed changes to the DPDD to remove reference to 'CoAddSource' and other intermediate data products

      4 Data Release Data Products
      4.1 Overview
      The master list of Objects in the Data Release will be generated by associating and deblending the list of single-epoch DIASource detections and the lists of sources detected on coadds (CoaddSources).
      Change: Remove specific reference to 'CoaddSources' and replace with 'coadds'. This is an intermediate data product, which is currently not part of the design and being removed from the DMSR.

      4.2 Data Release Data Processing

      Bullet 4. Coadd source detection. 
      Change : Remove link to DMS-REQ-0277

      Bullet 5. Association and deblending.
      Change: Remove 'CoaddSources' and replace with 'coadds'. 

      *New proposed text:  ...*In doing so it will consider lists  of sources detected on coadds (CoaddSources)., catalogs of DIASources, DIAObjects and SSObjects detected on difference images, and objects from external catalogs." 

      4.2.3 Source Characterization
      Change: Remove reference to DMS-REQ-0277

       

        Attachments

          Issue Links

            Activity

            Hide
            lguy Leanne Guy added a comment -

            I propose to add one more modification, an update to DMS-REQ-0267. The source catalog will not contain detections on Co-Adds, only single visits. This is most likely a reference to the intermediate CoaddSource catalog that this RFC proposes to remove. 

            1.4.1 Source Catalog ID: DMS-REQ-0267 (Priority: 1b)

            Specification: The DMS shall create a Catalog containing all Sources detected in single (standard) visits and on Co-Adds, and will contain an identifier of the Exposure on which the Source was detected, as well as measurements of Source Attributes.  .....

            New proposed Specification: The DMS shall create a Catalog containing all Sources detected in single (standard) visits and will contain an identifier of the Exposure on which the Source was detected, as well as measurements of Source Attributes. 

            Show
            lguy Leanne Guy added a comment - I propose to add one more modification, an update to DMS-REQ-0267. The source catalog will not contain detections on Co-Adds, only single visits. This is most likely a reference to the intermediate CoaddSource catalog that this RFC proposes to remove.  1.4.1 Source Catalog ID: DMS-REQ-0267 (Priority: 1b) Specification : The DMS shall create a Catalog containing all Sources detected in single (standard) visits and on Co-Adds, and will contain an identifier of the Exposure on which the Source was detected, as well as measurements of Source Attributes.  ..... New proposed Specification : The DMS shall create a Catalog containing all Sources detected in single (standard) visits and will contain an identifier of the Exposure on which the Source was detected, as well as measurements of Source Attributes. 

              People

              Assignee:
              lguy Leanne Guy
              Reporter:
              lguy Leanne Guy
              Watchers:
              Leanne Guy
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Planned End:

                  Jenkins Builds

                  No builds found.