[DM-9438] Switch default reference catalog for HSC to PS1 in LSST format - Jira

Details

Type: Story
Status: Done
Resolution: Done
Fix Version/s: None
Component/s: ci_hsc, obs_subaru
Labels:
None

Story Points:
1
Team:
Data Release Production

Description

With the availability of PS1 and Gaia catalogs in the LSST format, we can remove our dependence on astrometry.net. This involves changing configuration files to use the PS1 catalog in LSST format and disable the use of astrometry.net.

Attachments

Issue Links

blocks

DM-9870 Release hscPipe 5.0-beta1

Done

is triggering

DM-9909 hsc cat format change breaks processing of validation_data_hsc

Done

DM-11647 Switch validate_drp HSC test to use HTM reference catalog

Invalid

relates to

DM-11336 Switch default reference catalog for DECam to PS1 in LSST format

Done

DM-9931 Add dependency of "refcat" on "preSfm" in ci_hsc

Done

Activity

Ascending order - Click to sort in descending order

Hide

Permalink

Paul Price added a comment - 20/Mar/17 11:08 AM

Also need to update ci_hsc to include the required astrometry files.

Show

Paul Price added a comment - 20/Mar/17 11:08 AM Also need to update ci_hsc to include the required astrometry files.

Hide

Permalink

Paul Price added a comment - 20/Mar/17 8:16 PM

John Parejko, would you please review this? It's a blocker for the HSC release which we're hoping to get out maybe tomorrow, so please let me know if you can't look at it immediately and I'll find someone else.

This passes Jenkins (with ci_hsc under OSX!).

price@pap-laptop:~/LSST/obs_subaru (tickets/DM-9438=) $ git sub

commit 29ffad14ed28699ab35af7f779c4810b2054946d

Author: Paul Price <price@astro.princeton.edu>

Date:   Mon Mar 20 13:55:30 2017 -0400

    config: use PS1 reference catalog in LSST format

    This frees us from dependency on astrometry_net, and removes our reliance

    on eups for setting the configuration.

 config/Mosaic.py              | 13 ++++---------

 config/measureCoaddSources.py |  4 +++-

 config/processCcd.py          | 14 ++++----------

 3 files changed, 11 insertions(+), 20 deletions(-)

price@pap-laptop:~/LSST/ci_hsc (tickets/DM-9438=) $ git sub

commit 139759a7c9769ca5fe4b9404d81fe0575d28fc98

Author: Paul Price <price@astro.princeton.edu>

Date:   Mon Mar 20 15:03:50 2017 -0400

    add eupspkg.cfg.sh to support build on OSX

    This allows us to work around SIP on OSX.

    This apprently breaks python 3 builds, but ci_hsc is already

    broken for python 3.

 ups/eupspkg.cfg.sh | 14 ++++++++++++++

 1 file changed, 14 insertions(+)

commit c8e6796860184b52a261a015e73c3a6e1feac12e

Author: Paul Price <price@astro.princeton.edu>

Date:   Mon Mar 20 16:51:54 2017 -0400

    use PS1 reference catalog in LSST format

    This removes our required dependency on astrometry.net.

 SConstruct                                         |   8 +-

 ps1_pv3_3pi_20170110/189584.fits                   |   3 +

 ps1_pv3_3pi_20170110/189648.fits                   |   3 +

 ps1_pv3_3pi_20170110/README.txt                    | 487 +++++++++++++++++++++

 ps1_pv3_3pi_20170110/config.py                     |  10 +

 ps1_pv3_3pi_20170110/master_schema.fits            |   3 +

 python/lsst/ci/hsc/validate.py                     |   7 +-

 sdss-dr9-fink-v5b/README.txt                       |   3 -

 sdss-dr9-fink-v5b/andCache.fits                    |   3 -

 sdss-dr9-fink-v5b/andConfig.py                     |   7 -

 sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_0.fits |   3 -

 sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_1.fits |   3 -

 sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_2.fits |   3 -

 sdss-dr9-fink-v5b/ups/astrometry_net_data.table    |   0

 ups/ci_hsc.table                                   |   6 +-

 15 files changed, 518 insertions(+), 31 deletions(-)

commit 5f1e51ff093f9bfeda889dfa48b0b76776648174

Author: Paul Price <price@astro.princeton.edu>

Date:   Mon Mar 20 17:42:39 2017 -0400

    ups: require meas_extensions_photometryKron

    We want to ensure Kron is still working.

 ups/ci_hsc.table | 1 +

 1 file changed, 1 insertion(+)

Show

Paul Price added a comment - 20/Mar/17 8:16 PM John Parejko , would you please review this? It's a blocker for the HSC release which we're hoping to get out maybe tomorrow, so please let me know if you can't look at it immediately and I'll find someone else. This passes Jenkins (with ci_hsc under OSX!). price@pap-laptop:~/LSST/obs_subaru (tickets/DM-9438=) $ git sub commit 29ffad14ed28699ab35af7f779c4810b2054946d Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 13:55:30 2017 -0400 config: use PS1 reference catalog in LSST format This frees us from dependency on astrometry_net, and removes our reliance on eups for setting the configuration. config/Mosaic.py | 13 ++++--------- config/measureCoaddSources.py | 4 +++- config/processCcd.py | 14 ++++---------- 3 files changed, 11 insertions(+), 20 deletions(-) price@pap-laptop:~/LSST/ci_hsc (tickets/DM-9438=) $ git sub commit 139759a7c9769ca5fe4b9404d81fe0575d28fc98 Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 15:03:50 2017 -0400 add eupspkg.cfg.sh to support build on OSX This allows us to work around SIP on OSX. This apprently breaks python 3 builds, but ci_hsc is already broken for python 3. ups/eupspkg.cfg.sh | 14 ++++++++++++++ 1 file changed, 14 insertions(+) commit c8e6796860184b52a261a015e73c3a6e1feac12e Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 16:51:54 2017 -0400 use PS1 reference catalog in LSST format This removes our required dependency on astrometry.net. SConstruct | 8 +- ps1_pv3_3pi_20170110/189584.fits | 3 + ps1_pv3_3pi_20170110/189648.fits | 3 + ps1_pv3_3pi_20170110/README.txt | 487 +++++++++++++++++++++ ps1_pv3_3pi_20170110/config.py | 10 + ps1_pv3_3pi_20170110/master_schema.fits | 3 + python/lsst/ci/hsc/validate.py | 7 +- sdss-dr9-fink-v5b/README.txt | 3 - sdss-dr9-fink-v5b/andCache.fits | 3 - sdss-dr9-fink-v5b/andConfig.py | 7 - sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_0.fits | 3 - sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_1.fits | 3 - sdss-dr9-fink-v5b/sdss-dr9-fink-v5b_and_263_2.fits | 3 - sdss-dr9-fink-v5b/ups/astrometry_net_data.table | 0 ups/ci_hsc.table | 6 +- 15 files changed, 518 insertions(+), 31 deletions(-) commit 5f1e51ff093f9bfeda889dfa48b0b76776648174 Author: Paul Price <price@astro.princeton.edu> Date: Mon Mar 20 17:42:39 2017 -0400 ups: require meas_extensions_photometryKron We want to ensure Kron is still working. ups/ci_hsc.table | 1 + 1 file changed, 1 insertion(+)

Hide

Permalink

John Parejko added a comment - 20/Mar/17 9:34 PM

Can you please make the PRs for me to review?

Show

John Parejko added a comment - 20/Mar/17 9:34 PM Can you please make the PRs for me to review?

Hide

Permalink

Paul Price added a comment - 21/Mar/17 3:22 AM

Done. Sorry about that.

Show

Paul Price added a comment - 21/Mar/17 3:22 AM Done. Sorry about that.

Hide

Permalink

John Parejko added a comment - 21/Mar/17 11:05 AM

See comments in PRs.

Show

John Parejko added a comment - 21/Mar/17 11:05 AM See comments in PRs.

Hide

Permalink

Paul Price added a comment - 21/Mar/17 11:33 AM

Thanks John!

Merged to master.

Show

Paul Price added a comment - 21/Mar/17 11:33 AM Thanks John! Merged to master.

Data Management

Switch default reference catalog for HSC to PS1 in LSST format

Details

Description

Attachments

Issue Links

Activity

People

Dates

Jenkins