Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-4368

Duration for various ShapeletPsfApprox Models

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      This is just a report of the amount of time it takes to run ShapeletPsfApprox and CModel over 10000 galaxies from GalSim

        Attachments

          Activity

          Hide
          pgee Perry Gee added a comment - - edited

          These results differ in a few cases from the ones I sent you earlier. I reran several of the tests to be sure that they were correct

          I also have done the iterations count you asked for in several cases, though I did not try to include it here.

          The DM-4368.odt file contains the latest results.

          Show
          pgee Perry Gee added a comment - - edited These results differ in a few cases from the ones I sent you earlier. I reran several of the tests to be sure that they were correct I also have done the iterations count you asked for in several cases, though I did not try to include it here. The DM-4368 .odt file contains the latest results.
          Hide
          jbosch Jim Bosch added a comment -

          Review complete. I have nothing new to add, but I'll paste some of my statements from our previously off-line conversation here for posterity:

          It's interesting that the largest PSF images caused that many more failures (suggesting that it takes more iterations to fit more pixels on average), but looking at the other sizes I don't see a clear trend in terms of PSF image size vs. failure rate.

          I'm actually encouraged to see the the CModel speed with Full is only ~8x slower than with SingleGaussian; I expected it to be much worse than that, actually.

          Mostly, it's clear that I need to do some work on speeding up ShapeletPsfApprox to make it usable in practice, even for simple models. I'm pretty confident I can do that if I can just get some time to work on it. (I'm much less optimistic about being able to speed up CModel, which is why I've been paying more attention to how it scales with the PSF approximation complexity).

          Show
          jbosch Jim Bosch added a comment - Review complete. I have nothing new to add, but I'll paste some of my statements from our previously off-line conversation here for posterity: It's interesting that the largest PSF images caused that many more failures (suggesting that it takes more iterations to fit more pixels on average), but looking at the other sizes I don't see a clear trend in terms of PSF image size vs. failure rate. I'm actually encouraged to see the the CModel speed with Full is only ~8x slower than with SingleGaussian; I expected it to be much worse than that, actually. Mostly, it's clear that I need to do some work on speeding up ShapeletPsfApprox to make it usable in practice, even for simple models. I'm pretty confident I can do that if I can just get some time to work on it. (I'm much less optimistic about being able to speed up CModel, which is why I've been paying more attention to how it scales with the PSF approximation complexity).
          Hide
          pgee Perry Gee added a comment -

          I've added a couple of Full and DoubleShapelet model logs which have printouts of time and number of iterations from the size of the history recorder catalog. All but 2 are outer iterations.

          Show
          pgee Perry Gee added a comment - I've added a couple of Full and DoubleShapelet model logs which have printouts of time and number of iterations from the size of the history recorder catalog. All but 2 are outer iterations.
          Hide
          pgee Perry Gee added a comment -

          Verbose logs, including number of iterations

          Show
          pgee Perry Gee added a comment - Verbose logs, including number of iterations
          Hide
          pgee Perry Gee added a comment -

          Results attached to this ticket.

          Show
          pgee Perry Gee added a comment - Results attached to this ticket.

            People

            • Assignee:
              pgee Perry Gee
              Reporter:
              pgee Perry Gee
              Reviewers:
              Jim Bosch
              Watchers:
              Jim Bosch, John Swinbank, Perry Gee
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: