Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-20970

timeMethod gives platform-dependent results

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: utils
    • Labels:
    • Story Points:
      3
    • Team:
      Architecture

      Description

      The @timeMethod decorator is currently implemented in terms of Python's resource package, whose behavior depends on the operating system it is run on (for example, the resident set size may be given in bytes, kibibytes, or pages). This is particularly confusing in a distributed system, where the platform on which the decorator runs may not be obvious (see discussion on verify#47).

      Find a way to make this decorator more platform-agnostic; Tim Jenness has suggested using psutil instead of resource.

        Attachments

          Issue Links

            Activity

            Hide
            ktl Kian-Tat Lim added a comment -

            Generally OK. One philosophical qualm.

            Show
            ktl Kian-Tat Lim added a comment - Generally OK. One philosophical qualm.
            Hide
            tjenness Tim Jenness added a comment -

            For the record, psutil can't be used because it does not report maxrss (the argument being that it only reports things that can be obtained for any running process).

            Show
            tjenness Tim Jenness added a comment - For the record, psutil can't be used because it does not report maxrss (the argument being that it only reports things that can be obtained for any running process).
            Hide
            tjenness Tim Jenness added a comment -

            Kian-Tat Lim can you please take a look at this. I've moved all the getrusage into the usage file and added a version number. I didn't add units because I force the units to be bytes.

            Show
            tjenness Tim Jenness added a comment - Kian-Tat Lim can you please take a look at this. I've moved all the getrusage into the usage file and added a version number. I didn't add units because I force the units to be bytes.

              People

              Assignee:
              tjenness Tim Jenness
              Reporter:
              krzys Krzysztof Findeisen
              Reviewers:
              Kian-Tat Lim
              Watchers:
              Kian-Tat Lim, Krzysztof Findeisen, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins Builds

                  No builds found.