Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11736

Audit meas_base for use of single precision for internal variables

    XMLWordPrintable

    Details

    • Story Points:
      4
    • Team:
      Data Release Production

      Description

      In DM-10902 it became apparent that meas_base makes heavy use of single precision floats. While this is probably fine for output (e.g. when operating on an Image<float>, it does not always make sense for internal variables. Audit the code and check where double precision should be used instead (taking into account numerical rounding and performance factors).

        Attachments

          Issue Links

            Activity

            There are no comments yet on this issue.

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              pschella Pim Schellart [X] (Inactive)
              Watchers:
              John Swinbank, Pim Schellart [X] (Inactive), Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.