Uploaded image for project: 'Request For Comments'
  1. Request For Comments
  2. RFC-601

Adopt updated LDM-153: LSST Database Schema

    Details

    • Type: RFC
    • Status: Implemented
    • Resolution: Done
    • Component/s: DM
    • Labels:

      Description

       
      I propose to adopt a new version of LDM-153, the LSST Database Baseline Schema, based on the github repo lsst/LDM-153 and the schema defined in lsst/cat repo yaml files. It is available at http://ldm-153.lsst.io.
       
      The previous version was a Word document from 2013, which I have converted to LaTeX and a proper github repository. The descriptive text and figures are largely unchanged, except for some updates to the discussion of how the document itself is generated (i.e. it no longer mentions Enterprise Architect). The contents of the table schemas are now automatically pulled from the cat package, and a small script in the LDM-153 repo is used to convert the yaml files (in a felis-compatible format) to latex tables. 
       
      Adopting this new system means that the cat package baselineSchema.yaml should be treated as authoritative, and should not be edited without also submitting an RFC to update LDM-153.  Since LDM-153 was last updated, the baseline schema SQL definition file has been occasionally modified without RFCs (mostly updating column names). I am proposing to essentially grandfather those changes into this RFC, but in the future we should ensure that baseline schema updates get the proper sign-off from the DMCCB. 
       
      There is additional work that needs to be done after adoption of the new LDM-153 baseline: the online schema browser will need to be updated to pull from yaml instead of sql, the provenance part of the schema likely needs a substantial update, and the figures in the document need to be re-evaluated. I'd like to get this initial update baselined first though, so we can start accepting schema updates in the new format.
       
       

        Attachments

          Issue Links

            Activity

            Hide
            Parejkoj John Parejko added a comment -

            This sounds like a good idea to me. Per our offline discussion, I've filed DM-19970 for the updates I know need to be done to the YAML.

            Show
            Parejkoj John Parejko added a comment - This sounds like a good idea to me. Per our offline discussion, I've filed DM-19970 for the updates I know need to be done to the YAML.
            Hide
            ktl Kian-Tat Lim added a comment -

            As long as we're updating the front matter, perhaps we should remove the reference to launchpad.net for SciSQL?

            Otherwise, thumbs up from me.

            Show
            ktl Kian-Tat Lim added a comment - As long as we're updating the front matter, perhaps we should remove the reference to launchpad.net for SciSQL? Otherwise, thumbs up from me.
            Hide
            tjenness Tim Jenness added a comment -

            Please add a change record (it will be a new major version when finalized). There are also no references but there is a references section. Should DPDD be referenced somewhere as the science view of the tables described here?

            Show
            tjenness Tim Jenness added a comment - Please add a change record (it will be a new major version when finalized). There are also no references but there is a references section. Should DPDD be referenced somewhere as the science view of the tables described here?
            Hide
            lguy Leanne Guy added a comment -

            I support this RFC - add Colin + other contributors as authors as Jacek has left.

            Show
            lguy Leanne Guy added a comment - I support this RFC - add Colin + other contributors as authors as Jacek has left.

              People

              • Assignee:
                ctslater Colin Slater
                Reporter:
                ctslater Colin Slater
                Watchers:
                Andy Salnikov, Colin Slater, Fritz Mueller, Gabriele Comoretto, Gregory Dubois-Felsmann, John Parejko, John Swinbank, Kian-Tat Lim, Leanne Guy, Michelle Butler, Tim Jenness, Wil O'Mullane
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:
                  Planned End:

                  Summary Panel