Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26545

Add spline linearizer.

    XMLWordPrintable

Details

    • Improvement
    • Status: Done
    • Resolution: Done
    • None
    • cp_pipe, ip_isr
    • None
    • 8
    • Data Release Production

    Description

      Craig Lage has recently been obtaining results that indicate that we might also need to implement a spline fit option for the linearity.  This ticket will add this both to the measurement and application code.

      Attachments

        Issue Links

          Activity

            price Paul Price added a comment -

            We have spline code in PFS that you're welcome to port if that would be useful.

            price Paul Price added a comment - We have spline code in PFS that you're welcome to port if that would be useful.

            cslage reports that it's important to force the spline to match the linear curve at a low flux( less than 10000-20000 ADU), he says he has a way to do this if needed.

            plazas Andrés Alejandro Plazas Malagón added a comment - cslage reports that it's important to force the spline to match the linear curve at a low flux( less than 10000-20000 ADU), he says he has a way to do this if needed.
            cslage Craig Lage added a comment -

            After correcting a sign error, I ran this on 9-raft data from last year.  It appears to correct most of the "bump" in the variance/flux vs flux curve.  See the attached plot. There is still a small residual bump around 70,000 ADU that I don't like.  I'll continue investigating this.

            cslage Craig Lage added a comment - After correcting a sign error, I ran this on 9-raft data from last year.  It appears to correct most of the "bump" in the variance/flux vs flux curve.  See the attached plot. There is still a small residual bump around 70,000 ADU that I don't like.  I'll continue investigating this.
            czw Christopher Waters added a comment - Jenkins run: https://ci.lsst.codes/blue/organizations/jenkins/stack-os-matrix/detail/stack-os-matrix/32813/pipeline

            Comments on PRs.

            mfisherlevine Merlin Fisher-Levine added a comment - Comments on PRs.

            From running a test with the debug code enabled:

             

            F1: plot of the input data (expTime vs Flux), with filtered points marked in red.  The bottom panel shows the difference between the inputOrdinate and the linearOrdinate.

            F2: The top panel shows the bincenters and values for the correction in the top panel.  Bottom panel is useless due to choice of overloading one debug method.

            F3: The top panel shows the relation between the linear flux (x-axis) and the input flux (y-axis).  This is a less useful plot.  The bottom panel shows the residual between the the input flux and the model correction. 

             

            czw Christopher Waters added a comment - From running a test with the debug code enabled:   F1: plot of the input data (expTime vs Flux), with filtered points marked in red.  The bottom panel shows the difference between the inputOrdinate and the linearOrdinate. F2: The top panel shows the bincenters and values for the correction in the top panel.  Bottom panel is useless due to choice of overloading one debug method. F3: The top panel shows the relation between the linear flux (x-axis) and the input flux (y-axis).  This is a less useful plot.  The bottom panel shows the residual between the the input flux and the model correction.   

            People

              czw Christopher Waters
              czw Christopher Waters
              Merlin Fisher-Levine
              Andrés Alejandro Plazas Malagón, Christopher Waters, Craig Lage, Merlin Fisher-Levine, Paul Price
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.