Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-786

Add meas_extensions_gaap to lsst_distrib

    XMLWordPrintable

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:
      None

      Description

      Proposal to move the meas_extensions_gaap package to lsst organization on Github and add it to lsst_distrib. 

      `meas_extensions_gaap` is a measurement plugin intended to measure consistent galaxy colors for photometric redshift. It is an implementation of the Gaussian-Aperture and PSF photometry algorithm (Kuijken 2010, Kuijken et al. 2015) suited to Rubin science pipelines. Currently, it resides in https://github.com/lsst-dm/meas_extensions_gaap

       

      The algorithm standardizes the seeing to a Gaussian and produces colors that are largely insensitive to the seeing. It differs from existing flux measurement plugins in two ways:

      1. Unlike `meas_extensions_convolved`, where the convolution kernel is a Gaussian, the PSF in GAaP is convolved to be a Gaussian;
      2. Similar to `base_GaussianFlux`, the aperture to measure flux is Gaussian, after compensating for the PSF.

       

      These two characteristics ensure that the PSF is standardized more accurately, thus minimizing the seeing dependence. The hope is that the outputs of this plugin will become the standard color referred to in the Data Products Definition Document.

       

      The code has been developed in various ticket branches, each of which has been reviewed. The code has been written according the DM Python style guide and the build passes with scons. The unit tests are fairly extensive and cover almost 100% of the code. The core development is complete, with a few optimization tweaks pending and will see a few more improvements as results are seen during operations. There is an accompanying tech note (DMTN-190) under construction explaining the algorithm, the special test cases and relating the config parameters in the implementation to the mathematical quantities defined in the algorithm.

       

      By adding it to lsst_distrib, its performance on HSC RC2 data can be regularly monitored and improved upon after any regression.

       

      Non-standard dependencies: This package depends on scipy.signal submodule for the implementation and spicy.signal, numpy and galsim for the unit tests. All of these are available on rubin-env.

        Attachments

          Issue Links

            Activity

            Show
            kannawad Arun Kannawadi added a comment - Flagging per  https://developer.lsst.io/communications/rfc.html#standard-procedures-that-require-an-rfc
            Hide
            tjenness Tim Jenness added a comment -

            lsst_distrib is where meas_extensions packages get listed so this all seems reasonable assuming science pipelines want this package to be included.

            Show
            tjenness Tim Jenness added a comment - lsst_distrib is where meas_extensions packages get listed so this all seems reasonable assuming science pipelines want this package to be included.
            Hide
            jbosch Jim Bosch added a comment -

            , but best to do this as in indirect dependency of lsst_distrib (e.g. via having obs_subaru and/or obs_lsst depend on it - or drp_pipe if RFC-775 somehow gets implemented before this one against all odds).

            Show
            jbosch Jim Bosch added a comment - , but best to do this as in indirect dependency of lsst_distrib (e.g. via having obs_subaru and/or obs_lsst depend on it - or drp_pipe if RFC-775 somehow gets implemented before this one against all odds).
            Hide
            tjenness Tim Jenness added a comment -

            I see we do have some optional dependencies on measurement plugins in obs_subaru but I don't necessarily think that's something we want to continue doing since obs packages shouldn't really depend on general algorithmic code. Much better for it to either go in lsst_distrib for now or wait until the right _pipe package turns up in RFC-775.

            Show
            tjenness Tim Jenness added a comment - I see we do have some optional dependencies on measurement plugins in obs_subaru but I don't necessarily think that's something we want to continue doing since obs packages shouldn't really depend on general algorithmic code. Much better for it to either go in lsst_distrib for now or wait until the right _pipe package turns up in RFC-775 .
            Hide
            tjenness Tim Jenness added a comment -

            The CCB discussed this today and are happy for it to go in lsst_distrib pending the RFC-775 reorganization.

            Show
            tjenness Tim Jenness added a comment - The CCB discussed this today and are happy for it to go in lsst_distrib pending the RFC-775 reorganization.
            Hide
            kannawad Arun Kannawadi added a comment -

            Great! I will adopt this RFC and move the repository from lsst-dm to lsst org for now, and wait another week or so to see if RFC-775 progress. If not, can I go ahead and include it in lsst_distrib anyway? AFAIK, not having the package in lsst_distrib leads me to using a modified version of `ctrl_bps` to submit jobs (DM-29256).

            Show
            kannawad Arun Kannawadi added a comment - Great! I will adopt this RFC and move the repository from lsst-dm to lsst org for now, and wait another week or so to see if RFC-775 progress. If not, can I go ahead and include it in lsst_distrib anyway? AFAIK, not having the package in lsst_distrib leads me to using a modified version of `ctrl_bps` to submit jobs ( DM-29256 ).
            Hide
            tjenness Tim Jenness added a comment -

            You can add it to lsst_distrib. Don't forget to attach the "is triggering" ticket to this RFC and make sure Jenkins passes (and update the entry in repos.yaml)

            Show
            tjenness Tim Jenness added a comment - You can add it to lsst_distrib. Don't forget to attach the "is triggering" ticket to this RFC and make sure Jenkins passes (and update the entry in repos.yaml)

              People

              Assignee:
              kannawad Arun Kannawadi
              Reporter:
              kannawad Arun Kannawadi
              Watchers:
              Arun Kannawadi, Jim Bosch, John Parejko, Kian-Tat Lim, Tim Jenness, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Planned End:

                  Jenkins

                  No builds found.