XMLWordPrintable

#### Details

• Type: RFC
• Status: Implemented
• Resolution: Done
• Component/s:
• Labels:

#### Description

I would like to have a location on datasets to collect symlinks to HTM indexed catalogs that can be used by the new multi-reference catalog system: DM-8232. My suggestion is that it will be called /datasets/ref_cats_htm. There are currently only two catalogs that would be linked there. One is /datasets/refcats/gaia_DR1_v1/photo_astro_ref/, the other is /scratch/ctslater/sdss_dr9_refcat/photo_astro_ref/ which I've asked to be moved to /datasets/refcats/sdss_dr9/photo_astro_ref/ in DM-8672.

I am requesting a new name ref_cats_htm in addition to refcats since we now have two types of catalogs: a.net indexed and HTM indexed. Having a single place for all reference catalogs is probably good. We can then create a collection of just the HTM indexed catalogs in the proposed location.

I do not expect us to be changing the available catalogs often or that we will ever have more than a handful of these. To be concrete, my proposal is that, once DM-8672 is closed, the structure that looks like the following:

 datasets ├── ref_cats_htm │   ├── gaia -> /datasets/refcats/gaia_DR1_v1/photo_astro_ref/ │   └── sdss -> /datasets/refcats/sdss_dr9/photo_astro_ref/ 

#### Activity

Hide
Hsin-Fang Chiang added a comment -

• All reference catalogs live within /datasets/refcats/.
• Within /datasets/refcats/ there are /datasets/refcats/astrometry_net_data/ and /datasets/refcats/htm/. Real data live in subfolders of either folder with descriptive names. For example, /datasets/refcats/htm/gaia_DR1_v1 and /datasets/refcats/htm/sdss_dr9 (RFC-264).
• The collections of HTM indexed catalogs that Simon Krughoff needs can live in another folder. This folder will contain many symlinks. It can be /datasets/refcats/htm_best or /datasets/refcats/htm/best/ or any suggestion of a better name? Simon Krughoff what do you think?
Show
Hsin-Fang Chiang added a comment - How about this: All reference catalogs live within /datasets/refcats/ . Within /datasets/refcats/ there are /datasets/refcats/astrometry_net_data/ and /datasets/refcats/htm/ . Real data live in subfolders of either folder with descriptive names. For example, /datasets/refcats/htm/gaia_DR1_v1 and /datasets/refcats/htm/sdss_dr9 ( RFC-264 ). The collections of HTM indexed catalogs that Simon Krughoff needs can live in another folder. This folder will contain many symlinks. It can be /datasets/refcats/htm_best or /datasets/refcats/htm/best/ or any suggestion of a better name? Simon Krughoff what do you think?
Hide
Simon Krughoff added a comment -

Hsin-Fang Chiang This sounds just fine to me, for the most part. I'm slightly worried that the name htm_best implies some sort of vetting on our part, so maybe we call it htm_baseline or htm_current.

Jason Alt [X] It sounds like this is pretty much in line with an earlier suggestion from you. Are you happy enough with this solution to call this RFC adopted?

Show
Simon Krughoff added a comment - Hsin-Fang Chiang This sounds just fine to me, for the most part. I'm slightly worried that the name htm_best implies some sort of vetting on our part, so maybe we call it htm_baseline or htm_current . Jason Alt [X] It sounds like this is pretty much in line with an earlier suggestion from you. Are you happy enough with this solution to call this RFC adopted?
Hide
Hsin-Fang Chiang added a comment -

htm_baseline or htm_current sounds good

Show
Hsin-Fang Chiang added a comment - htm_baseline or htm_current sounds good
Hide
Jason Alt [X] (Inactive) added a comment -

This sounds great.

Show
Jason Alt [X] (Inactive) added a comment - This sounds great.
Hide
Simon Krughoff added a comment -

Marking this as adopted. I've created DM-8708 to do the implementation.

Show
Simon Krughoff added a comment - Marking this as adopted. I've created DM-8708 to do the implementation.

#### People

Assignee:
Simon Krughoff
Reporter:
Simon Krughoff
Watchers:
Colin Slater, Hsin-Fang Chiang, Jason Alt [X] (Inactive), Simon Krughoff, Tim Jenness
0 Vote for this issue
Watchers:
5 Start watching this issue

#### Dates

Created:
Updated:
Resolved:
Planned End:

#### CI Builds

No builds found.