Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-7040

Stars selected by starSelector change when number of cores varies

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Epic Link:
    • Sprint:
      DRP F16-3
    • Team:
      Data Release Production

      Description

      Sogo Mineo writes in HSC-1414:

      See the following lines:

      meas_algorithms/HSC-4.0.0/python/lsst/meas/algorithms/objectSizeStarSelector.py:466
      in ObjectSizeStarSelector.selectStars():

          if psfCandidate.getWidth() == 0:
              psfCandidate.setBorderWidth(self._borderWidth)
              psfCandidate.setWidth(self._kernelSize + 2*self._borderWidth)
              psfCandidate.setHeight(self._kernelSize + 2*self._borderWidth)
      

      In reduceFrames, these lines set the width of psfCandidate to be 21
      for the first time the execution reaches there.

      When the first CCD image has been processed, the worker process
      continues to process another CCD image, and the execution reaches
      here again. This time, psfCandidate.getWidth() is 41, because
      psfexPsfDeterminer has set it to be 41, and the value has been
      retained because the width is a static member. And so, for the second
      CCD image, the width of psfCandidate is not 21 but 41.

      Since psfCandidates are widened, stars positioned at edges of images
      are rejected. It results in a smaller number of PSF candidates than expected.

      Only CCD images that are initially given to the worker processes
      are processed with psfCandidate.getWidth() == 21. The other CCD images are
      processed with psfCandidate.getWidth() == 41.
      When the number of SMP cores changes, CCD images are processed with different
      parameters.

      The change in the number of PSF candidates results in different Psf, a different
      result of image repair, and different catalogs.

      The line numbers are different on the LSST side because of refactoring (objectSizeStarSelector.py:466 has moved to starSelector.py:148), but the bug is still present. The main problem appears to be that the PsfCandidate elements are static, are being set in both the star selector and the PSF determiner and one of those is conditional on what the value is. I will investigate moving the static class variables to instance variables — the desired size appears to vary by context, so it shouldn't be a class variable.

        Attachments

          Issue Links

            Activity

            price Paul Price created issue -
            swinbank John Swinbank made changes -
            Field Original Value New Value
            Epic Link DM-6172 [ 24685 ]
            swinbank John Swinbank made changes -
            Sprint DRP F16-3 [ 237 ]
            Story Points 2
            Team Data Release Production [ 10301 ]
            price Paul Price made changes -
            Reviewers Perry Gee [ pgee ]
            Status To Do [ 10001 ] In Review [ 10004 ]
            pgee Perry Gee made changes -
            Status In Review [ 10004 ] To Do [ 10001 ]
            swinbank John Swinbank made changes -
            Status To Do [ 10001 ] Reviewed [ 10101 ]
            price Paul Price made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            lauren Lauren MacArthur made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            rhl Robert Lupton made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            rhl Robert Lupton made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            price Paul Price made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            pschella Pim Schellart [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            pschella Pim Schellart [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            rhl Robert Lupton made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            jbosch Jim Bosch made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            rowen Russell Owen made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            rowen Russell Owen made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            krzys Krzysztof Findeisen made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            swinbank John Swinbank made changes -
            Remote Link This issue links to "Page (Confluence)" [ 14164 ] This issue links to "Page (Confluence)" [ 14164 ]
            Parejkoj John Parejko made changes -
            Link This issue relates to DM-15121 [ DM-15121 ]
            swinbank John Swinbank made changes -
            Link This issue relates to DM-19155 [ DM-19155 ]

              People

              Assignee:
              price Paul Price
              Reporter:
              price Paul Price
              Reviewers:
              Perry Gee
              Watchers:
              Jim Bosch, Paul Price, Perry Gee
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.