Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-264

Move SDSS DR9 reference catalogs to /datasets

    XMLWordPrintable

Details

    • RFC
    • Status: Implemented
    • Resolution: Done
    • DM
    • None

    Description

      ctslater has sharded the SDSS DR9 catalogs. I'd like to move them into the standard spot on /datasets which currently is refcats.

      As noted, this would end up being /datasets/refcats/htm/sdss_dr9.

      Attachments

        Issue Links

          Activity

            Colin Slater has sharded the SDSS DR9 catalogs

            Does this mean that the catalog is in Qserv?

            xiuqin Xiuqin Wu [X] (Inactive) added a comment - Colin Slater has sharded the SDSS DR9 catalogs Does this mean that the catalog is in Qserv?

            No, they are not in Qserv. This is a simple on disk database for the reference catalogs where each shard contains the lines from the reference in a particular HTM trixel.

            krughoff Simon Krughoff (Inactive) added a comment - No, they are not in Qserv. This is a simple on disk database for the reference catalogs where each shard contains the lines from the reference in a particular HTM trixel.

            What database do you use? What software do you use to make the shards, search the data? I am asking because the private data storage we want to do for users. SUIT wants to save and search those data for users. We may explore SQLite.

            xiuqin Xiuqin Wu [X] (Inactive) added a comment - What database do you use? What software do you use to make the shards, search the data? I am asking because the private data storage we want to do for users. SUIT wants to save and search those data for users. We may explore SQLite.

            We are not using an RDBMS. It is a database in a generic sense. In other words, it's just a bunch of files stored on disk. We shard the input catalog using code I wrote in the DM stack using a python library written by Erin Sheldon (esutil).

            krughoff Simon Krughoff (Inactive) added a comment - We are not using an RDBMS. It is a database in a generic sense. In other words, it's just a bunch of files stored on disk. We shard the input catalog using code I wrote in the DM stack using a python library written by Erin Sheldon (esutil).

            Marking as adopted since there were no arguments.

            krughoff Simon Krughoff (Inactive) added a comment - Marking as adopted since there were no arguments.

            I believe the target directory is /datasets/refcats/htm/sdss_dr9. Slight derivation from the camera layouts but similar to the htm/gaia layout.

            jalt Jason Alt [X] (Inactive) added a comment - I believe the target directory is /datasets/refcats/htm/sdss_dr9. Slight derivation from the camera layouts but similar to the htm/gaia layout.

            This was renamed to /datasets/refcats/htm/sdss-dr9-fink-v5b/ and immutability has been applied.

            hchiang2 Hsin-Fang Chiang added a comment - This was renamed to /datasets/refcats/htm/sdss-dr9-fink-v5b/ and immutability has been applied.

            People

              krughoff Simon Krughoff (Inactive)
              krughoff Simon Krughoff (Inactive)
              Hsin-Fang Chiang, Jason Alt [X] (Inactive), Simon Krughoff (Inactive), Xiuqin Wu [X] (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:
                Planned End:

                Jenkins

                  No builds found.