Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-39836

Speed up FitAffineWcsTask

    XMLWordPrintable

Details

    • 5
    • Ops Pipelines 2023
    • Data Release Production
    • No

    Description

      Trying out FitAffineWcsTask in the new CalibrateImage and comparing runtimes with the old Characterize and Calibrate showed me that FitAffineWcsTask is about 20x slower than FitTanSipWcsTask. Most of that time is spent in some scipy.optimize calls: there might be faster ones we could use instead.

      We still haven't switched to use the new affine fitter anywhere, but I think we should do so soon.

      This is at least a partial blocker to using the affine fitter for AP, as previously astrometry was a negligible part of our pipeline (less than half a second), and with the affine fitter it's about 5 seconds.

      Attachments

        Issue Links

          Activity

            jbosch Jim Bosch added a comment -

            Looks great!  I'm glad turned out to be as simple as it seems to have been.  A few comments (mostly about code comments) on the PR.

             

            jbosch Jim Bosch added a comment - Looks great!  I'm glad turned out to be as simple as it seems to have been.  A few comments (mostly about code comments) on the PR.  
            nlust Nate Lust added a comment -

            Final solution speeds this task up by about a factor of 36x, and makes it about 3 times faster than FitTanSipWcsTask (at least in the limited test case).

             

            Parejkoj Do you think you could run this again in the context the ticket was created and see how it performs now?

            nlust Nate Lust added a comment - Final solution speeds this task up by about a factor of 36x, and makes it about 3 times faster than FitTanSipWcsTask (at least in the limited test case).   Parejkoj Do you think you could run this again in the context the ticket was created and see how it performs now?
            Parejkoj John Parejko added a comment -

            Thanks for the quick fix! Yes, this now makes FitAffineWcsTask take a bit less time than FitTanSipWcsTask on my test dataset. Nice work! AstrometryTask is back down to about 0.6s, most of which is in matchPessimisticB. This is now far down the list of things we want to optimize further, so I can stop thinking about astrometry for a while.

            Parejkoj John Parejko added a comment - Thanks for the quick fix! Yes, this now makes FitAffineWcsTask take a bit less time than FitTanSipWcsTask on my test dataset. Nice work! AstrometryTask is back down to about 0.6s, most of which is in matchPessimisticB. This is now far down the list of things we want to optimize further, so I can stop thinking about astrometry for a while.

            People

              nlust Nate Lust
              Parejkoj John Parejko
              Jim Bosch
              Clare Saunders, Ian Sullivan, Jim Bosch, John Parejko, Nate Lust, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.