Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22096

Check sizing model and improve

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Design Documents
    • Labels:
      None
    • Sprint:
      Arch 2019-11-04
    • Team:
      Architecture

      Description

      The sizing model is conservative with regard to scaling compute and storage by input data (approximately proportional to ForcedSources) and sky area (approximately proportional to Objects).  Compare with previous numbers for HSC and attempt to generate a more accurate model.

        Attachments

          Activity

          Hide
          Permalink
          ktl Kian-Tat Lim added a comment -

          ed HSC numbers and tested scaling by sky area, tracts, patches, and visits for each timing component.  Spot-checked timings to ensure elapsed node-hours were actually nodes, not cores, and that they did not include excessive overheads (like waiting for input data).  Started collecting additional information from Euclid (via RHL) and DES.

          Show
          ktl Kian-Tat Lim added a comment - ed HSC numbers and tested scaling by sky area, tracts, patches, and visits for each timing component.  Spot-checked timings to ensure elapsed node-hours were actually nodes, not cores, and that they did not include excessive overheads (like waiting for input data).  Started collecting additional information from Euclid (via RHL) and DES.

            People

            Assignee:
            ktl Kian-Tat Lim
            Reporter:
            ktl Kian-Tat Lim
            Watchers:
            Kian-Tat Lim
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.