Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9874

Increase matcher.numBrightStars

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: obs_subaru
    • Labels:
    • Team:
      Data Release Production

      Description

      Recently, while processing MADCASH (observations of local dwarf galaxies), I noticed a vast improvement in astrometric matching when I set:

      calibrate.astrometry.matcher.numBrightStars=150 calibrate.photoCal.matcher.n
      umBrightStars=150
      

      We should make these the default for HSC.

        Attachments

          Issue Links

            Activity

            Hide
            price Paul Price added a comment -

            Chris Morrison [X], would you mind giving this simple change a quick look, as I believe you grok this stuff.

            price@pap-laptop:~/LSST/obs_subaru (tickets/DM-9874=) $ git sub-patch
            commit e378a39f4967f0b8567b335288e9f621115e1118
            Author: Paul Price <price@astro.princeton.edu>
            Date:   Mon Mar 20 13:00:34 2017 -0400
             
                config: set matcher.numBrightStars=150
                
                This greatly increases the stability of the matcher, at least for
                MADCASH dwarf galaxy fields. There's also evidence from UW astrometry
                experiments that it helps in general.
             
            diff --git a/config/processCcd.py b/config/processCcd.py
            index a1a7d2e..2d9755d 100644
            --- a/config/processCcd.py
            +++ b/config/processCcd.py
            @@ -34,6 +34,10 @@ for refObjLoader in (config.calibrate.astromRefObjLoader,
                                  ):
                 refObjLoader.load(os.path.join(getPackageDir("obs_subaru"), "config", "filterMap.py"))
             
            +# Better astrometry matching
            +config.calibrate.astrometry.matcher.numBrightStars = 150
            +config.calibrate.photoCal.matcher.numBrightStars = 150
            +
             # Set to match defaults curretnly used in HSC production runs (e.g. S15B)
             config.charImage.catalogCalculation.plugins['base_ClassificationExtendedness'].fluxRatio = 0.95
             config.calibrate.catalogCalculation.plugins['base_ClassificationExtendedness'].fluxRatio = 0.95
            

            Show
            price Paul Price added a comment - Chris Morrison [X] , would you mind giving this simple change a quick look, as I believe you grok this stuff. price@pap-laptop:~/LSST/obs_subaru (tickets/DM-9874=) $ git sub-patch commit e378a39f4967f0b8567b335288e9f621115e1118 Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 13:00:34 2017 -0400   config: set matcher.numBrightStars=150 This greatly increases the stability of the matcher, at least for MADCASH dwarf galaxy fields. There's also evidence from UW astrometry experiments that it helps in general.   diff --git a/config/processCcd.py b/config/processCcd.py index a1a7d2e..2d9755d 100644 --- a/config/processCcd.py +++ b/config/processCcd.py @@ -34,6 +34,10 @@ for refObjLoader in (config.calibrate.astromRefObjLoader, ): refObjLoader.load(os.path.join(getPackageDir("obs_subaru"), "config", "filterMap.py")) +# Better astrometry matching +config.calibrate.astrometry.matcher.numBrightStars = 150 +config.calibrate.photoCal.matcher.numBrightStars = 150 + # Set to match defaults curretnly used in HSC production runs (e.g. S15B) config.charImage.catalogCalculation.plugins['base_ClassificationExtendedness'].fluxRatio = 0.95 config.calibrate.catalogCalculation.plugins['base_ClassificationExtendedness'].fluxRatio = 0.95
            Hide
            cmorrison Chris Morrison [X] (Inactive) added a comment -

            Hey Paul,

            This is basically one of the major problems with the current matcher set up. Turns out in denser fields 50 bright stars is too few to successfully match on.

            One quick question before I approve this change, have you tried excluding saturated and interpolated objects from the source sample? I found that in dense stellar fields the first 50 objects by brightness are all saturated and causes the matcher to fail or give bad fits. I'm likely going to change the matcherSourceSelector to exclude these objects completely and instead rely on a S/N cut to pull in more objects if needed. Would be interesting to hear if you also have problem with saturated objects.

            Show
            cmorrison Chris Morrison [X] (Inactive) added a comment - Hey Paul, This is basically one of the major problems with the current matcher set up. Turns out in denser fields 50 bright stars is too few to successfully match on. One quick question before I approve this change, have you tried excluding saturated and interpolated objects from the source sample? I found that in dense stellar fields the first 50 objects by brightness are all saturated and causes the matcher to fail or give bad fits. I'm likely going to change the matcherSourceSelector to exclude these objects completely and instead rely on a S/N cut to pull in more objects if needed. Would be interesting to hear if you also have problem with saturated objects.
            Hide
            price Paul Price added a comment -

            I haven't tried that. Is there a quick config option to enable that?

            Show
            price Paul Price added a comment - I haven't tried that. Is there a quick config option to enable that?
            Hide
            cmorrison Chris Morrison [X] (Inactive) added a comment -

            Unfortunately no. You'd have to change the ordering of the isUseable and isGood flags in matchOptimsiticBTask or just switch isUseable for isGood. I'm going to hopefully implement this change as part of DM-9750. I'll mark this ticket as reviewed. These are the visit numbers you sent me previously correct? I'll take a look at them once I start my validating my replacement matcher against a large volume of data.

            Show
            cmorrison Chris Morrison [X] (Inactive) added a comment - Unfortunately no. You'd have to change the ordering of the isUseable and isGood flags in matchOptimsiticBTask or just switch isUseable for isGood. I'm going to hopefully implement this change as part of DM-9750 . I'll mark this ticket as reviewed. These are the visit numbers you sent me previously correct? I'll take a look at them once I start my validating my replacement matcher against a large volume of data.
            Hide
            cmorrison Chris Morrison [X] (Inactive) added a comment -

            Change in number of brightStars approved. This change does help the success rate of a generic implementation of matchOptimisticB as has been worked on in DM-7366. Future releases may also want to remove saturated and interpolated objects from matching. This is planned to happen as part of DM-9750.

            Show
            cmorrison Chris Morrison [X] (Inactive) added a comment - Change in number of brightStars approved. This change does help the success rate of a generic implementation of matchOptimisticB as has been worked on in DM-7366 . Future releases may also want to remove saturated and interpolated objects from matching. This is planned to happen as part of DM-9750 .
            Hide
            price Paul Price added a comment -

            Thanks Chris!

            This passed Jenkins.

            Show
            price Paul Price added a comment - Thanks Chris! This passed Jenkins .
            Hide
            price Paul Price added a comment -

            Merged to master.

            Show
            price Paul Price added a comment - Merged to master.

              People

              Assignee:
              price Paul Price
              Reporter:
              price Paul Price
              Reviewers:
              Chris Morrison [X] (Inactive)
              Watchers:
              Chris Morrison [X] (Inactive), Paul Price
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.