Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-9438

Switch default reference catalog for HSC to PS1 in LSST format

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ci_hsc, obs_subaru
    • Labels:
      None
    • Story Points:
      1
    • Team:
      Data Release Production

      Description

      With the availability of PS1 and Gaia catalogs in the LSST format, we can remove our dependence on astrometry.net. This involves changing configuration files to use the PS1 catalog in LSST format and disable the use of astrometry.net.

        Attachments

          Issue Links

            Activity

            price Paul Price created issue -
            price Paul Price made changes -
            Field Original Value New Value
            Link This issue blocks DM-9870 [ DM-9870 ]
            price Paul Price made changes -
            Component/s ci_hsc [ 13140 ]
            Hide
            price Paul Price added a comment -

            Also need to update ci_hsc to include the required astrometry files.

            Show
            price Paul Price added a comment - Also need to update ci_hsc to include the required astrometry files.
            Hide
            price Paul Price added a comment -

            John Parejko, would you please review this? It's a blocker for the HSC release which we're hoping to get out maybe tomorrow, so please let me know if you can't look at it immediately and I'll find someone else.

            This passes Jenkins (with ci_hsc under OSX!).

            price@pap-laptop:~/LSST/obs_subaru (tickets/DM-9438=) $ git sub
            commit 29ffad14ed28699ab35af7f779c4810b2054946d
            Author: Paul Price <price@astro.princeton.edu>
            Date:   Mon Mar 20 13:55:30 2017 -0400
             
                config: use PS1 reference catalog in LSST format
                
                This frees us from dependency on astrometry_net, and removes our reliance
                on eups for setting the configuration.
             
             config/Mosaic.py              | 13 ++++---------
             config/measureCoaddSources.py |  4 +++-
             config/processCcd.py          | 14 ++++----------
             3 files changed, 11 insertions(+), 20 deletions(-)
             
             
            price@pap-laptop:~/LSST/ci_hsc (tickets/DM-9438=) $ git sub
            commit 139759a7c9769ca5fe4b9404d81fe0575d28fc98
            Author: Paul Price <price@astro.princeton.edu>
            Date:   Mon Mar 20 15:03:50 2017 -0400
             
                add eupspkg.cfg.sh to support build on OSX
                
                This allows us to work around SIP on OSX.
                
                This apprently breaks python 3 builds, but ci_hsc is already
                broken for python 3.
             
             ups/eupspkg.cfg.sh | 14 ++++++++++++++
             1 file changed, 14 insertions(+)
             
            commit c8e6796860184b52a261a015e73c3a6e1feac12e
            Author: Paul Price <price@astro.princeton.edu>
            Date:   Mon Mar 20 16:51:54 2017 -0400
             
                use PS1 reference catalog in LSST format
                
                This removes our required dependency on astrometry.net.
             
             SConstruct                                         |   8 +-
             ps1_pv3_3pi_20170110/189584.fits                   |   3 +
             ps1_pv3_3pi_20170110/189648.fits                   |   3 +
             ps1_pv3_3pi_20170110/README.txt                    | 487 +++++++++++++++++++++
             ps1_pv3_3pi_20170110/config.py                     |  10 +
             ps1_pv3_3pi_20170110/master_schema.fits            |   3 +
             python/lsst/ci/hsc/validate.py                     |   7 +-
             sdss-dr9-fink-v5b/README.txt                       |   3 -
             sdss-dr9-fink-v5b/andCache.fits                    |   3 -
             sdss-dr9-fink-v5b/andConfig.py                     |   7 -
             sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_0.fits |   3 -
             sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_1.fits |   3 -
             sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_2.fits |   3 -
             sdss-dr9-fink-v5b/ups/astrometry_net_data.table    |   0
             ups/ci_hsc.table                                   |   6 +-
             15 files changed, 518 insertions(+), 31 deletions(-)
             
            commit 5f1e51ff093f9bfeda889dfa48b0b76776648174
            Author: Paul Price <price@astro.princeton.edu>
            Date:   Mon Mar 20 17:42:39 2017 -0400
             
                ups: require meas_extensions_photometryKron
                
                We want to ensure Kron is still working.
             
             ups/ci_hsc.table | 1 +
             1 file changed, 1 insertion(+)
            

            Show
            price Paul Price added a comment - John Parejko , would you please review this? It's a blocker for the HSC release which we're hoping to get out maybe tomorrow, so please let me know if you can't look at it immediately and I'll find someone else. This passes Jenkins (with ci_hsc under OSX!). price@pap-laptop:~/LSST/obs_subaru (tickets/DM-9438=) $ git sub commit 29ffad14ed28699ab35af7f779c4810b2054946d Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 13:55:30 2017 -0400   config: use PS1 reference catalog in LSST format This frees us from dependency on astrometry_net, and removes our reliance on eups for setting the configuration.   config/Mosaic.py | 13 ++++--------- config/measureCoaddSources.py | 4 +++- config/processCcd.py | 14 ++++---------- 3 files changed, 11 insertions(+), 20 deletions(-)     price@pap-laptop:~/LSST/ci_hsc (tickets/DM-9438=) $ git sub commit 139759a7c9769ca5fe4b9404d81fe0575d28fc98 Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 15:03:50 2017 -0400   add eupspkg.cfg.sh to support build on OSX This allows us to work around SIP on OSX. This apprently breaks python 3 builds, but ci_hsc is already broken for python 3.   ups/eupspkg.cfg.sh | 14 ++++++++++++++ 1 file changed, 14 insertions(+)   commit c8e6796860184b52a261a015e73c3a6e1feac12e Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 16:51:54 2017 -0400   use PS1 reference catalog in LSST format This removes our required dependency on astrometry.net.   SConstruct | 8 +- ps1_pv3_3pi_20170110/189584.fits | 3 + ps1_pv3_3pi_20170110/189648.fits | 3 + ps1_pv3_3pi_20170110/README.txt | 487 +++++++++++++++++++++ ps1_pv3_3pi_20170110/config.py | 10 + ps1_pv3_3pi_20170110/master_schema.fits | 3 + python/lsst/ci/hsc/validate.py | 7 +- sdss-dr9-fink-v5b/README.txt | 3 - sdss-dr9-fink-v5b/andCache.fits | 3 - sdss-dr9-fink-v5b/andConfig.py | 7 - sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_0.fits | 3 - sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_1.fits | 3 - sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_2.fits | 3 - sdss-dr9-fink-v5b/ups/astrometry_net_data.table | 0 ups/ci_hsc.table | 6 +- 15 files changed, 518 insertions(+), 31 deletions(-)   commit 5f1e51ff093f9bfeda889dfa48b0b76776648174 Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 17:42:39 2017 -0400   ups: require meas_extensions_photometryKron We want to ensure Kron is still working.   ups/ci_hsc.table | 1 + 1 file changed, 1 insertion(+)
            price Paul Price made changes -
            Reviewers John Parejko [ parejkoj ]
            Status To Do [ 10001 ] In Review [ 10004 ]
            Hide
            Parejkoj John Parejko added a comment -

            Can you please make the PRs for me to review?

            Show
            Parejkoj John Parejko added a comment - Can you please make the PRs for me to review?
            Hide
            price Paul Price added a comment -

            Done. Sorry about that.

            Show
            price Paul Price added a comment - Done. Sorry about that.
            Hide
            Parejkoj John Parejko added a comment -

            See comments in PRs.

            Show
            Parejkoj John Parejko added a comment - See comments in PRs.
            Parejkoj John Parejko made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            Hide
            price Paul Price added a comment -

            Thanks John!

            Merged to master.

            Show
            price Paul Price added a comment - Thanks John! Merged to master.
            price Paul Price made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            jhoblitt Joshua Hoblitt made changes -
            Link This issue is triggering DM-9909 [ DM-9909 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue relates to DM-9931 [ DM-9931 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue relates to DM-11336 [ DM-11336 ]
            hchiang2 Hsin-Fang Chiang made changes -
            Link This issue is triggering DM-11647 [ DM-11647 ]

              People

              • Assignee:
                price Paul Price
                Reporter:
                price Paul Price
                Reviewers:
                John Parejko
                Watchers:
                John Parejko, John Swinbank, Lauren MacArthur, Paul Price
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel