Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22096

Check sizing model and improve

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Design Documents
    • Labels:
      None
    • Sprint:
      Arch 2019-11-04
    • Team:
      Architecture

      Description

      The sizing model is conservative with regard to scaling compute and storage by input data (approximately proportional to ForcedSources) and sky area (approximately proportional to Objects).  Compare with previous numbers for HSC and attempt to generate a more accurate model.

        Attachments

          Activity

          Hide
          ktl Kian-Tat Lim added a comment -

          ed HSC numbers and tested scaling by sky area, tracts, patches, and visits for each timing component.  Spot-checked timings to ensure elapsed node-hours were actually nodes, not cores, and that they did not include excessive overheads (like waiting for input data).  Started collecting additional information from Euclid (via RHL) and DES.

          Show
          ktl Kian-Tat Lim added a comment - ed HSC numbers and tested scaling by sky area, tracts, patches, and visits for each timing component.  Spot-checked timings to ensure elapsed node-hours were actually nodes, not cores, and that they did not include excessive overheads (like waiting for input data).  Started collecting additional information from Euclid (via RHL) and DES.

            People

            • Assignee:
              ktl Kian-Tat Lim
              Reporter:
              ktl Kian-Tat Lim
              Watchers:
              Kian-Tat Lim
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel