Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-13733

Add hooks for extracting metadata from InMemoryDataset on Butler.put

    XMLWordPrintable

    Details

    • Story Points:
      6
    • Team:
      Ops Middleware

      Description

      When an InMemoryDataset is put metadata needs to be extracted from it to write into the relevant Registry metadata table(s).
      This hook probably needs to be specified / overridden at the StorageClass, DatasetType and potentially parameters (to Butler.put) level.

        Attachments

          Issue Links

          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21773 Add support for per-StorageClass metadata fields

          • To Do

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            swinbank John Swinbank added a comment -

            (Setting team to DAX since I assume Fritz Mueller is managing this work)

            Show
            swinbank John Swinbank added a comment - (Setting team to DAX since I assume Fritz Mueller is managing this work)
            Hide
            Permalink
            tjenness Tim Jenness added a comment -

            As things stand, it's the assemblers that understand how to extract information from the in memory dataset so I think that might be the best place.

            Show
            tjenness Tim Jenness added a comment - As things stand, it's the assemblers that understand how to extract information from the in memory dataset so I think that might be the best place.
            Hide
            Permalink
            tjenness Tim Jenness added a comment -

            I'm no longer sure I understand what this ticket is asking for.

            Show
            tjenness Tim Jenness added a comment - I'm no longer sure I understand what this ticket is asking for.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            This is about populating those StorageClass- or DatasetType-specific metadata tables we've always planned to add to Registry but have never gotten around to.

            Show
            jbosch Jim Bosch added a comment - This is about populating those StorageClass- or DatasetType-specific metadata tables we've always planned to add to Registry but have never gotten around to.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            DM-21773 will add registry support for these fields, including a way to specify what fields should exist in StorageClass configuration and a way to pass the values to Registry when inserting datasets.  This ticket will then be about adding support to datastores/formatters/butler to extract the values and pass it along.

            Show
            jbosch Jim Bosch added a comment - DM-21773 will add registry support for these fields, including a way to specify what fields should exist in StorageClass configuration and a way to pass the values to Registry when inserting datasets.  This ticket will then be about adding support to datastores/formatters/butler to extract the values and pass it along.

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              pschella Pim Schellart [X] (Inactive)
              Watchers:
              Jim Bosch, John Swinbank, Michelle Gower, Pim Schellart [X] (Inactive), Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.