Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-8414

Investigate alternatives to ingest JSON blobs into the SQUASH database

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      SQuaSH uses MySQL/MariaDB for the development and production databases, it is implemented through the Django-MySQL package to add specific features of MySQL/MariaDB to Django. In particular, we are interested in the JSON data type to store the validate_drp outputs. That seems very convenient as these outputs can vary widely and we don’t want to to turn all the details into a relational model.

        Attachments

          Issue Links

          is child task of

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-7043 Update SQuaSH database model and JSON API with concepts from validate_drp measurement API

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-6330 move qa-dashboard deployment to using python3

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-8890 Investigate if MariaDB 10.1+ DynamicField() can be used for storing JSON blobs

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Implemented in the ticket branch tickets/DM-8414

            Technote was updated with associated documentation: http://sqr-009.lsst.io/en/latest/#setting-up-the-database

            Show
            afausti Angelo Fausti added a comment - Implemented in the ticket branch tickets/ DM-8414 Technote was updated with associated documentation: http://sqr-009.lsst.io/en/latest/#setting-up-the-database
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Also created a community post to get more feedaback on this

            https://community.lsst.org/t/using-json-data-type-to-minimize-database-schema-changes/1440

            Show
            afausti Angelo Fausti added a comment - Also created a community post to get more feedaback on this https://community.lsst.org/t/using-json-data-type-to-minimize-database-schema-changes/1440
            Hide
            Permalink
            afausti Angelo Fausti added a comment -

            Changes pushed to ticket branch, pending tests with MariaDB 10.1+

            Show
            afausti Angelo Fausti added a comment - Changes pushed to ticket branch, pending tests with MariaDB 10.1+

              People

              Assignee:
              afausti Angelo Fausti
              Reporter:
              afausti Angelo Fausti
              Watchers:
              Angelo Fausti
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.