Details
-
Type:
RFC
-
Status: Implemented
-
Resolution: Done
-
Component/s: DM
-
Labels:None
Description
Colin Slater has sharded the SDSS DR9 catalogs. I'd like to move them into the standard spot on /datasets which currently is refcats.
As noted, this would end up being /datasets/refcats/htm/sdss_dr9.
Attachments
Issue Links
- is triggering
-
- Done
Activity
No, they are not in Qserv. This is a simple on disk database for the reference catalogs where each shard contains the lines from the reference in a particular HTM trixel.
What database do you use? What software do you use to make the shards, search the data? I am asking because the private data storage we want to do for users. SUIT wants to save and search those data for users. We may explore SQLite.
We are not using an RDBMS. It is a database in a generic sense. In other words, it's just a bunch of files stored on disk. We shard the input catalog using code I wrote in the DM stack using a python library written by Erin Sheldon (esutil).
Marking as adopted since there were no arguments.
I believe the target directory is /datasets/refcats/htm/sdss_dr9. Slight derivation from the camera layouts but similar to the htm/gaia layout.
Jason Alt [X] (Inactive)
added a comment - I believe the target directory is /datasets/refcats/htm/sdss_dr9. Slight derivation from the camera layouts but similar to the htm/gaia layout. This was renamed to /datasets/refcats/htm/sdss-dr9-fink-v5b/ and immutability has been applied.
Hsin-Fang Chiang
added a comment - This was renamed to /datasets/refcats/htm/sdss-dr9-fink-v5b/ and immutability has been applied.
Does this mean that the catalog is in Qserv?