Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-768

Add meas_extensions_trailedSources to lsst_distrib

    XMLWordPrintable

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:
      None

      Description

      meas_extensions_trailedSources is a measurement plugin that characterizes fast-moving, trailed sources. Mainly, it aims to measure the length, angle, and flux. The current implementation involves two main algorithms: 

      1. Naive: Utilizes previously measured second moments to estimate the length and angle of a trail, and compute the end points. This model is inexpensive to compute, but under-estimates length. 
      2. Vereš: A chi-squared minimization using the analytic model from Vereš et al. 2012 – an axisymmetric Gaussian convolved with a line. Uses the Naive measurements and centroid as the initial parameter guess. This model assumes the flux in a given pixel is the value of the model at the center of that pixel. It estimates true length better, but is more computationally expensive than the Naive model. It also adds a flux, and centroid measurement. 

      Further development is ongoing. A correction to the Naive measurement is being investigated as well a third algorithm to provide a full forward model for high signal-to-noise trails. The overall goal is to provide a 'smart' plugin that runs each algorithm sequentially, base on signal-to-noise. Ie. For low signal-to-noise, the precision of the Naive measurement will be suitable. If the signal-to-noise is higher, then the next algorithm will be run, and so on.

      The package is currently available at lsst/meas_extensions_trailedSourceslsst-dm/meas_extensions_trailedSources. It includes unit tests for each measurement algorithm and is able to be setup along side lsst_distrib. Only dependencies outside of lsst_distrib are scipy.optimize and numpy.

        Attachments

          Issue Links

            Activity

            No builds found.
            langfzac Zach Langford [X] (Inactive) created issue -
            langfzac Zach Langford [X] (Inactive) made changes -
            Field Original Value New Value
            Description meas_extensions_trailedSources is a measurement plugin that characterizes fast-moving, trailed sources. Mainly, it aims to measure the length, angle, and flux. The current implementation involves two main algorithms: 
             # Naive: Utilizes previously measured second moments to estimate the length and angle of a trail, and compute the end points. This model is inexpensive to compute, but under-estimates length. 
             # Vereš: A chi-squared minimization using the analytic model from Vereš et al. 2012 – an axisymmetric Gaussian convolved with a line. Uses the Naive measurements and centroid as the initial parameter guess. This model assumes the flux in a given pixel is the value of the model at the center of that pixel. It estimates true length better, but is more computationally expensive than the Naive model. It also adds a flux, and centroid measurement. 

            Further development is ongoing. A correction to the Naive measurement is being investigated as well a third algorithm to provide a full forward model for high signal-to-noise trails. The overall goal is to provide a 'smart' plugin that runs each algorithm sequentially, base on signal-to-noise. Ie. For low signal-to-noise, the precision of the Naive measurement will be suitable. If the signal-to-noise is higher, then the next algorithm will be run, and so on.

            The package is currently available at [lsst-dm/meas_extensions_trailedSources|[https://github.com/lsst-dm/meas_extensions_trailedSources]|https://github.com/lsst-dm/meas_extensions_trailedSources].]. It includes unit tests for each measurement algorithm and is able to be setup along side lsst_distrib. Only dependencies outside of lsst_distrib are scipy.optimize and numpy.
            meas_extensions_trailedSources is a measurement plugin that characterizes fast-moving, trailed sources. Mainly, it aims to measure the length, angle, and flux. The current implementation involves two main algorithms: 
             # Naive: Utilizes previously measured second moments to estimate the length and angle of a trail, and compute the end points. This model is inexpensive to compute, but under-estimates length. 
             # Vereš: A chi-squared minimization using the analytic model from Vereš et al. 2012 – an axisymmetric Gaussian convolved with a line. Uses the Naive measurements and centroid as the initial parameter guess. This model assumes the flux in a given pixel is the value of the model at the center of that pixel. It estimates true length better, but is more computationally expensive than the Naive model. It also adds a flux, and centroid measurement. 

            Further development is ongoing. A correction to the Naive measurement is being investigated as well a third algorithm to provide a full forward model for high signal-to-noise trails. The overall goal is to provide a 'smart' plugin that runs each algorithm sequentially, base on signal-to-noise. Ie. For low signal-to-noise, the precision of the Naive measurement will be suitable. If the signal-to-noise is higher, then the next algorithm will be run, and so on.

            The package is currently available at [lsst-dm/meas_extensions_trailedSources|http://github.com/lsst-dm/meas_extensions_trailedSources]. It includes unit tests for each measurement algorithm and is able to be setup along side lsst_distrib. Only dependencies outside of lsst_distrib are scipy.optimize and numpy.
            Hide
            ktl Kian-Tat Lim added a comment -
            Show
            ktl Kian-Tat Lim added a comment - Flagging per https://developer.lsst.io/communications/rfc.html#standard-procedures-that-require-an-rfc as "Adding a new package to the build".
            ktl Kian-Tat Lim made changes -
            Status Proposed [ 10805 ] Flagged [ 10606 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 27964 ]
            Hide
            mrawls Meredith Rawls added a comment -

            Nice, this sounds like a useful addition. Feel free to reach out if you want some DECam images with real satellite trails to test it on. Please consider adding some meaningful content to the doc directory before you add this package to the build.

            Show
            mrawls Meredith Rawls added a comment - Nice, this sounds like a useful addition. Feel free to reach out if you want some DECam images with real satellite trails to test it on. Please consider adding some meaningful content to the doc directory before you add this package to the build.
            ebellm Eric Bellm made changes -
            Watchers Ian Sullivan, John Parejko, Kian-Tat Lim, Mario Juric, Meredith Rawls, Zach Langford [ Ian Sullivan, John Parejko, Kian-Tat Lim, Mario Juric, Meredith Rawls, Zach Langford ] Eric Bellm, Ian Sullivan, John Parejko, Kian-Tat Lim, Mario Juric, Meredith Rawls, Zach Langford [ Eric Bellm, Ian Sullivan, John Parejko, Kian-Tat Lim, Mario Juric, Meredith Rawls, Zach Langford ]
            tjenness Tim Jenness made changes -
            Status Flagged [ 10606 ] Board Recommended [ 11405 ]
            Hide
            tjenness Tim Jenness added a comment -

            DMCCB have no problem with adding this package to lsst_distrib but we request that there is a code review by science pipelines before it is added.

            Show
            tjenness Tim Jenness added a comment - DMCCB have no problem with adding this package to lsst_distrib but we request that there is a code review by science pipelines before it is added.
            Hide
            tjenness Tim Jenness added a comment -

            Remember also to add the standard lint.yaml GitHub action.

            Show
            tjenness Tim Jenness added a comment - Remember also to add the standard lint.yaml GitHub action.
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28021 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28091 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28138 ]
            Hide
            tjenness Tim Jenness added a comment -

            Zach Langford [X] can you please decide if you are going to adopt this RFC? Its review period has expired and the DMCCB are happy for this RFC to be adopted. Please mark it as adopted and link an "is triggering" ticket to do the implementation work.

            Show
            tjenness Tim Jenness added a comment - Zach Langford [X] can you please decide if you are going to adopt this RFC? Its review period has expired and the DMCCB are happy for this RFC to be adopted. Please mark it as adopted and link an "is triggering" ticket to do the implementation work.
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28193 ]
            langfzac Zach Langford [X] (Inactive) made changes -
            Status Board Recommended [ 11405 ] Adopted [ 10806 ]
            Hide
            langfzac Zach Langford [X] (Inactive) added a comment -

            Yes. Thanks, Tim! (Still new to this process).

            Show
            langfzac Zach Langford [X] (Inactive) added a comment - Yes. Thanks, Tim! (Still new to this process).
            langfzac Zach Langford [X] (Inactive) made changes -
            Link This issue is triggering DM-29795 [ DM-29795 ]
            langfzac Zach Langford [X] (Inactive) made changes -
            Link This issue is triggering DM-30633 [ DM-30633 ]
            langfzac Zach Langford [X] (Inactive) made changes -
            Description meas_extensions_trailedSources is a measurement plugin that characterizes fast-moving, trailed sources. Mainly, it aims to measure the length, angle, and flux. The current implementation involves two main algorithms: 
             # Naive: Utilizes previously measured second moments to estimate the length and angle of a trail, and compute the end points. This model is inexpensive to compute, but under-estimates length. 
             # Vereš: A chi-squared minimization using the analytic model from Vereš et al. 2012 – an axisymmetric Gaussian convolved with a line. Uses the Naive measurements and centroid as the initial parameter guess. This model assumes the flux in a given pixel is the value of the model at the center of that pixel. It estimates true length better, but is more computationally expensive than the Naive model. It also adds a flux, and centroid measurement. 

            Further development is ongoing. A correction to the Naive measurement is being investigated as well a third algorithm to provide a full forward model for high signal-to-noise trails. The overall goal is to provide a 'smart' plugin that runs each algorithm sequentially, base on signal-to-noise. Ie. For low signal-to-noise, the precision of the Naive measurement will be suitable. If the signal-to-noise is higher, then the next algorithm will be run, and so on.

            The package is currently available at [lsst-dm/meas_extensions_trailedSources|http://github.com/lsst-dm/meas_extensions_trailedSources]. It includes unit tests for each measurement algorithm and is able to be setup along side lsst_distrib. Only dependencies outside of lsst_distrib are scipy.optimize and numpy.
            meas_extensions_trailedSources is a measurement plugin that characterizes fast-moving, trailed sources. Mainly, it aims to measure the length, angle, and flux. The current implementation involves two main algorithms: 
             # Naive: Utilizes previously measured second moments to estimate the length and angle of a trail, and compute the end points. This model is inexpensive to compute, but under-estimates length. 
             # Vereš: A chi-squared minimization using the analytic model from Vereš et al. 2012 – an axisymmetric Gaussian convolved with a line. Uses the Naive measurements and centroid as the initial parameter guess. This model assumes the flux in a given pixel is the value of the model at the center of that pixel. It estimates true length better, but is more computationally expensive than the Naive model. It also adds a flux, and centroid measurement. 

            Further development is ongoing. A correction to the Naive measurement is being investigated as well a third algorithm to provide a full forward model for high signal-to-noise trails. The overall goal is to provide a 'smart' plugin that runs each algorithm sequentially, base on signal-to-noise. Ie. For low signal-to-noise, the precision of the Naive measurement will be suitable. If the signal-to-noise is higher, then the next algorithm will be run, and so on.

            The package is currently available at [lsst/meas_extensions_trailedSources|http://github.com/lsst/meas_extensions_trailedSources]-lsst-dm/meas_extensions_trailedSources-. It includes unit tests for each measurement algorithm and is able to be setup along side lsst_distrib. Only dependencies outside of lsst_distrib are scipy.optimize and numpy.
            langfzac Zach Langford [X] (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status Adopted [ 10806 ] Implemented [ 11105 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 28803 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 29159 ]

              People

              Assignee:
              langfzac Zach Langford [X] (Inactive)
              Reporter:
              langfzac Zach Langford [X] (Inactive)
              Watchers:
              Eric Bellm, Ian Sullivan, John Parejko, Kian-Tat Lim, Mario Juric, Meredith Rawls, Tim Jenness, Zach Langford [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:
                Planned End:

                  Jenkins

                  No builds found.