Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-23624

Get MEDIAN_PER_ROW overscan correction moved to afw, or find numpy replacement

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: afw, ip_isr
    • Labels:
      None
    • Story Points:
      6
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Currently, doing 2,000 (i.e. nRowsPerAmp) separate calls to afwMath x16 amps to take advantage of the integer median code is untenably slow. We can either find a way of dealing with the AuxTel bias effect that makes this necessary in some other way, find a way of doing the same as afw does in a quick way in numpy/numba/something-in-python, or add code to afw that allows this in a single call (it's not intrinsically slow; other afw stats methods allow a single call to return a column-length vector for overscan, just this treatment isn't supported.)

        Attachments

          Issue Links

            Activity

            Hide
            nlust Nate Lust added a comment -

            I made a few suggestions, including potentially a speed optimization, adopt any or all at your discretion.

            Show
            nlust Nate Lust added a comment - I made a few suggestions, including potentially a speed optimization, adopt any or all at your discretion.
            Hide
            rhl Robert Lupton added a comment -

            An alternative (which costs 1/12 in variance) is `np.median(data + np.random.uniform(size=data.shape), axis=...)`

            Show
            rhl Robert Lupton added a comment - An alternative (which costs 1/12 in variance) is `np.median(data + np.random.uniform(size=data.shape), axis=...)`

              People

              Assignee:
              czw Christopher Waters
              Reporter:
              mfisherlevine Merlin Fisher-Levine
              Reviewers:
              Nate Lust
              Watchers:
              Andrés Alejandro Plazas Malagón, Christopher Waters, John Swinbank, Merlin Fisher-Levine, Nate Lust, Robert Lupton
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.