Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21766

Add per-dataset-type tables to Registry

    XMLWordPrintable

    Details

    • Story Points:
      0
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields.

      This should move the schema to something like the "Partition datasets (only)" design on https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21773 Add support for per-StorageClass metadata fields

          • To Do
          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21448 Clean up DatasetRef comparisons and immutability

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21764 Better encapsulate dataset storage in Registry

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21849 Make runs a type of collection

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23079 Move opaque table Registry code into helper classes

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23080 Move dimension Registry code into helper classes

          • Done
          is contained by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21231 Refactor Registry handling of dataset and associated tables

          • Done

            Activity

            Ascending order - Click to sort in descending order
            No builds found.
            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Epic Link DM-21254 [ 414685 ]
            jbosch Jim Bosch made changes -
            Link This issue is contained by DM-21231 [ DM-21231 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-21448 [ DM-21448 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-21764 [ DM-21764 ]
            jbosch Jim Bosch made changes -
            Link This issue blocks DM-21773 [ DM-21773 ]
            jbosch Jim Bosch made changes -
            Description Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields. Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields.

            This should move the schema to something like
            jbosch Jim Bosch made changes -
            Link This issue blocks DM-21849 [ DM-21849 ]
            jbosch Jim Bosch made changes -
            Description Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields.

            This should move the schema to something like             		Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields.

            This should move the schema to something like the "Partition datasets (only)" design on [https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization|https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization.].
            jbosch Jim Bosch made changes -
            Labels gen3-middleware gen2-deprecation-blocker gen3-middleware
            dinob Dino Bektesevic made changes -
            Description Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields.

            This should move the schema to something like the "Partition datasets (only)" design on [https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization|https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization.].             		Move dimension foreign key fields to separate, per-dataset-type tables.  Duplicate primary key fields and optionally (via configuration) duplicate other fields.

            This should move the schema to something like the "Partition datasets (only)" design on [https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization|https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization].
            yusra Yusra AlSayyad made changes -
            Epic Link DM-21254 [ 414685 ] DM-22586 [ 427653 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-23080 [ DM-23080 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-23079 [ DM-23079 ]
            jbosch Jim Bosch made changes -
            Link This issue blocks DM-21849 [ DM-21849 ]
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-21849 [ DM-21849 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-22586 [ 427653 ] DM-23737 [ 431393 ]
            tjenness Tim Jenness made changes -
            Labels gen2-deprecation-blocker gen3-middleware gen2-deprecation-blocker gen3-middleware gen3-registry-incompatibility
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            This work is being done on the branch for DM-21764; I've zeroed the story points here and will mark as done as soon as that ticket closes.

            Show
            jbosch Jim Bosch added a comment - This work is being done on the branch for DM-21764 ; I've zeroed the story points here and will mark as done as soon as that ticket closes.
            jbosch Jim Bosch made changes -
            Story Points 2 0
            Urgent? off
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Note that these will actually be per-sets-of-dimensions (e.g. calexp and src will go in the same table, as both are identified by visit+detector). We'd be able to implement per-DatasetType tables and swap that in via configuration on another ticket if desired, but there's no sign that it is right now.

            Show
            jbosch Jim Bosch added a comment - Note that these will actually be per-sets-of-dimensions (e.g. calexp and src will go in the same table, as both are identified by visit+detector). We'd be able to implement per-DatasetType tables and swap that in via configuration on another ticket if desired, but there's no sign that it is right now.
            jbosch Jim Bosch made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.