Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21773

Add support for per-StorageClass metadata fields

    XMLWordPrintable

    Details

      Description

      Add support for metadata fields in per-dataset-type tables, as defined in StorageClass configuration.  Should include support for spatial regions and timespans.

      This ticket only includes emitting DDL according to and inserting metadata values passed explicitly to Registry methods.

        Attachments

          Issue Links

            Activity

            Hide
            tjenness Tim Jenness added a comment -

            Jim Bosch can you explain a bit more what this ticket means please?

            Show
            tjenness Tim Jenness added a comment - Jim Bosch can you explain a bit more what this ticket means please?
            Hide
            jbosch Jim Bosch added a comment -

            This means putting things like numbers of pixels (for images) or numbers of rows (for catalogs) or other summary information into new Registry tables whose schemas would be set by the StorageClass (Michelle Gower has more/better examples, I think).  This is something we've promised from working group days.  It's only relevant for Gen2 deprecation because it might affect schemas in a hard-to-migrate way.

            Show
            jbosch Jim Bosch added a comment - This means putting things like numbers of pixels (for images) or numbers of rows (for catalogs) or other summary information into new Registry tables whose schemas would be set by the StorageClass ( Michelle Gower has more/better examples, I think).  This is something we've promised from working group days.  It's only relevant for Gen2 deprecation because it might affect schemas in a hard-to-migrate way.
            Hide
            mgower Michelle Gower added a comment -

            How do these fit in with the proposed changes in the proposed table reorganization?  What criteria determines whether the value goes into a dataset type table as opposed to a StorageClass table?

            Show
            mgower Michelle Gower added a comment - How do these fit in with the proposed changes in the proposed  table reorganization ?  What criteria determines whether the value goes into a dataset type table as opposed to a StorageClass table?
            Hide
            jbosch Jim Bosch added a comment -

            I believe I included these metadata fields in the table reorganization examples, though they were not the emphasis there, and I was probably lazy there about distinguishing between per-DatasetType and per-StorageClass metadata.  I'd like to try to avoid true per-DatasetType metadata, as it's much easier to imagine how to hang logic for extracting metadata from in-memory datasets off of existing StorageClass mechanisms, and I don't know how we'd solve that problem for DatasetType-specific stuff.

            Show
            jbosch Jim Bosch added a comment - I believe I included these metadata fields in the table reorganization examples, though they were not the emphasis there, and I was probably lazy there about distinguishing between per-DatasetType and per-StorageClass metadata.  I'd like to try to avoid true per-DatasetType metadata, as it's much easier to imagine how to hang logic for extracting metadata from in-memory datasets off of existing StorageClass mechanisms, and I don't know how we'd solve that problem for DatasetType-specific stuff.
            Hide
            jbosch Jim Bosch added a comment -

            Tim Jenness, I think we should remove this from the schema stability milestone label - while it will involve schema changes when we decide to do it, I think they'll represent an easy migration (just addition of tables, and maybe a column or two) and we don't otherwise need to do it for Gen2 deprecation.

            Show
            jbosch Jim Bosch added a comment - Tim Jenness , I think we should remove this from the schema stability milestone label - while it will involve schema changes when we decide to do it, I think they'll represent an easy migration (just addition of tables, and maybe a column or two) and we don't otherwise need to do it for Gen2 deprecation.
            Hide
            tjenness Tim Jenness added a comment -

            Ok

            Show
            tjenness Tim Jenness added a comment - Ok

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Christopher Stephens [X] (Inactive), Jim Bosch, Michelle Gower, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.