Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-2787

Footprint dilation performance regression

    Details

    • Type: Story
    • Status: Done
    • Priority: Major
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: afw
    • Labels:
      None

      Description

      In DM-1128 we implemented span-based dilation for footprints. A brief test on synthetic data indicated that this was a performance win over the previous version of the code.

      In May 2015, this code was merged to HSC and applied to significant quantities of real data for the first time. A major performance regression was identified:

      [May-9 00:26] Paul Price: processCcd is now crazy slow.
      [May-9 00:29] Paul Price: Profiling...
      [May-9 00:40] Paul Price: I'm thinking it's the Footprint grow code...
      [May-9 00:44] Paul Price: And the winner is…. Footprint construction:
      [May-9 00:44] Paul Price: 2 0.000 0.000 702.280 351.140 /home/astro/hsc/products/Linux64/meas_algorithms/HSC-3.8.0/python/lsst/meas/algorithms/detection.py:191(makeSourceCatalog)
 2 0.005 0.002 702.274 351.137 /home/astro/hsc/products/Linux64/meas_algorithms/HSC-3.8.0/python/lsst/meas/algorithms/detection.py:228(detectFootprints)
 15 0.001 0.000 698.597 46.573 /home/pprice/hsc/afw/python/lsst/afw/detection/detectionLib.py:3448(_init_)
 15 698.596 46.573 698.596 46.573 {_detectionLib.new_FootprintSet}
      [May-9 00:53] Paul Price: If I revert HSC-1243 ("Port better Footprint-grow code from LSST"), then the performance regression goes away. @jbosch @jds may be interested...

      The source of the regression must be identified and resolved for both HSC and LSST.

        Attachments

          Container Issues

            Activity

              People

              • Assignee:
                swinbank John Swinbank
                Reporter:
                swinbank John Swinbank
                Reviewers:
                Paul Price
                Watchers:
                Jim Bosch, John Swinbank, Paul Price, Robert Lupton
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel