Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-232

Request for change to DecamMapper.paf

    XMLWordPrintable

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:
      None

      Description

      RFC for DM-7677: recommended changes to decamMapper.paf file

      Request to modify some templates and dataset names to make the obs_*
      Mapper classes more consistent.

      DM-7049 was intended to make the Mapper datasets more consistent
      by centralizing datasets which could be shared across Mappers.
      The latest HscMapper.paf was used as a model. Datasets were moved
      to datasets.yaml and exposures.yaml in daf_butlerUtils.

      1. Datasets in the individual Mapper.paf which matched the shared
      ones in butlerUtils were deleted. To avoid changing any datasets
      deletion was only done on those matched in both name and content.
      Those which matched in name but not content are listed (1) below.

      2. Datasets were also flagged when it appeared that they could
      be shareable, but in fact were not in HscMapper at all. These
      are candidates to be renamed and moved to daf_butlerUtils.
      Some of these could also be datasets no longer in use.

      Please also see RFC-231 for datasets which are specifically
      connected to Coadd and Difference imaging. They were omitted
      from (2).
      -------------------------------------

      1. Datasets with same name but different content in decamMapper.paf
      The difference is shown between the existing paf dataset and the
      proposed change to the "ref": the dataset is defined in butlerUtils.

      datasets.deepCoadd_calexp_background
            template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/b
                    	kgd-%(filter)s-%(tract)d-%(patch)s.fits
        ref:template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/d
                    	et_bkgd-%(filter)s-%(tract)d-%(patch)s.fits
      datasets.deep_safeClipAssembleCoadd_config
            template	config/deep_assembleCoadd.py
        ref:template	config/deep_safeClipAssembleCoadd.py
      datasets.deepCoadd_forced_metadata
            template	deepCoadd-results/forcedPhotCoadd_metadata/%(filte
                    	r)s/%(tract)d/%(patch)s.boost
        ref:template	deepCoadd_forcedPhotCoadd_metadata/%(filter)s/%(tr
                    	act)d/%(patch)s.boost
      datasets.deep_makeCoaddTempExp_metadata
            template	deepCoadd/%(filter)s/%(tract)d/%(patch)s/makeCoadd
                    	TempExpMD.boost
        ref:template	deep_makeCoaddTempExp_metadata/%(filter)s/%(tract)
                    	d/%(patch)s_metadata.boost
      datasets.deepCoadd_forced_src
            template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/f
                    	orcedSrc-%(filter)s-%(tract)d-%(patch)s.fits
        ref:template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/f
                    	orced_src-%(filter)s-%(tract)d-%(patch)s.fits
      datasets.measureCoaddSources_metadata
            template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/m
                    	easMD.boost
        ref:template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/m
                    	easMD-%(filter)s-%(tract)d-%(patch)s.boost
      datasets.mergeCoaddMeasurements_metadata
            template	deepCoadd-results/merged/%(tract)d/%(patch)s/merge
                    	MeasMD.boost
        ref:template	deepCoadd-results/merged/%(tract)d/%(patch)s/merge
                    	MeasMD-%(tract)d-%(patch)s.boost
      datasets.deep_safeClipAssembleCoadd_metadata
            template	deepCoadd/%(filter)s/%(tract)d/%(patch)s/assembleC
                    	oaddMD.boost
        ref:template	deep_assembleCoadd_metadata/%(filter)s/%(tract)d/%
                    	(patch)s.boost
      datasets.detectCoaddSources_metadata
            template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/d
                    	etectCoaddMD.boost
        ref:template	deepCoadd-results/%(filter)s/%(tract)d/%(patch)s/d
                    	etectMD-%(filter)s-%(tract)d-%(patch)s.boost
      datasets.detectCoaddSources_config
            template	config/detectCoadd.py
        ref:template	config/detect.py
      datasets.measureCoaddSources_config
            template	config/measureMergedCoadd.py
        ref:template	config/measureMerged.py
      

      -------------------------------------

      2. Datasets which should be examined to see if they should be
      removed, renamed, or moved to dafButlerUtils.
      Note mappers with the same dataset name are shown:
      l=lsstSim,d=decam,s=suprimecam,S=sdss,m=megacam,t=test

      datasets.deep_makeSkyMap_config: dmSl
      datasets.processCcdDecam_config: d
      datasets.processCcdDecam_metadata: d
      

        Attachments

          Issue Links

            Activity

            Hide
            ctslater Colin Slater added a comment -

            I have no objections to changing these to the standardized versions. processCcdDecam_* can be removed; I don't know what deep_makeSkyMap is.

            Show
            ctslater Colin Slater added a comment - I have no objections to changing these to the standardized versions. processCcdDecam_* can be removed; I don't know what deep_makeSkyMap is.
            Hide
            pgee Perry Gee added a comment - - edited

            Here is a revised set of recommendations after RFC-231 (DM-7884) is merged:

            1. Examine line in Mapper.paf marked with the following comment to be sure differerence are necessary

            1. dataset defined in obs_base modified in this mapper as follows:

            2. Remove processCcdDecam config and metadata.

            3. Remove deep_makeSkyMap_config

            4. Remove deepCoadd override of "level"

            Show
            pgee Perry Gee added a comment - - edited Here is a revised set of recommendations after RFC-231 ( DM-7884 ) is merged: 1. Examine line in Mapper.paf marked with the following comment to be sure differerence are necessary dataset defined in obs_base modified in this mapper as follows: 2. Remove processCcdDecam config and metadata. 3. Remove deep_makeSkyMap_config 4. Remove deepCoadd override of "level"
            Hide
            pgee Perry Gee added a comment -

            Implemented changes to this Mapper.paf from RFC-232

            Show
            pgee Perry Gee added a comment - Implemented changes to this Mapper.paf from RFC-232
            Hide
            pgee Perry Gee added a comment -

            The modifications for the last described set of changes will appear in DM-8128

            Show
            pgee Perry Gee added a comment - The modifications for the last described set of changes will appear in DM-8128

              People

              Assignee:
              pgee Perry Gee
              Reporter:
              pgee Perry Gee
              Watchers:
              Colin Slater, Jim Bosch, Michael Wood-Vasey [X] (Inactive), Perry Gee, Russell Owen
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Planned End:

                  Jenkins Builds

                  No builds found.