Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12570

Look into whether metrics should be deterministic

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Currently validate_drp produces measurements which are not completely deterministic from run to run. This is due to differences in selection of random samples. We should investigate whether that's acceptable.

      As a side note, there will be measurements that cannot be deterministic: e.g. runtime. So, it's not clear to me that this is a problem.

        Attachments

          Activity

          There are no comments yet on this issue.

            People

            • Assignee:
              krughoff Simon Krughoff
              Reporter:
              krughoff Simon Krughoff
              Watchers:
              John Parejko, Krzysztof Findeisen, Simon Krughoff
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Summary Panel