Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-11736

Audit meas_base for use of single precision for internal variables

    Details

    • Templates:
    • Story Points:
      4
    • Team:
      Data Release Production

      Description

      In DM-10902 it became apparent that meas_base makes heavy use of single precision floats. While this is probably fine for output (e.g. when operating on an Image<float>, it does not always make sense for internal variables. Audit the code and check where double precision should be used instead (taking into account numerical rounding and performance factors).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                pschella Pim Schellart [X] (Inactive)
                Watchers:
                John Swinbank, Pim Schellart [X] (Inactive), Tim Jenness
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Summary Panel