Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24432

Add CALIBRATION collections and remove the calibration_label dimension

    XMLWordPrintable

    Details

    • Story Points:
      12
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      As per the prototype, add CALIBRATION-type collections that include a validity range in associations, and remove the calibration_label dimension. Update downstream code.

        Attachments

          Issue Links

            Activity

            No builds found.
            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Link This issue is blocked by DM-21764 [ DM-21764 ]
            jbosch Jim Bosch made changes -
            Link This issue is contained by DM-21231 [ DM-21231 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-24734 [ DM-24734 ]
            jbosch Jim Bosch made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            Hide
            jbosch Jim Bosch added a comment -

            Started this because it was both the tallest pole in the QG generation profiles and a schema change. But now I think I'm going to go do DM-24938 first, as that'll inform how I want to structure the tables to make sure the lookups in QG generation are fast. There is a branch here, but it just adds an enum value and documentation for it.

            Show
            jbosch Jim Bosch added a comment - Started this because it was both the tallest pole in the QG generation profiles and a schema change. But now I think I'm going to go do DM-24938 first, as that'll inform how I want to structure the tables to make sure the lookups in QG generation are fast. There is a branch here, but it just adds an enum value and documentation for it.
            tjenness Tim Jenness made changes -
            Labels gen3-middleware gen3-registry-incompatibility gen2-deprecation-blocker gen3-middleware gen3-registry-incompatibility
            jbosch Jim Bosch made changes -
            Link This issue is blocked by DM-26336 [ DM-26336 ]
            jbosch Jim Bosch made changes -
            Story Points 6
            Hide
            jbosch Jim Bosch added a comment -

            I think I see a path towards merging this before implementing much of the query/dimensions changes prototyped on DM-26336. That will leave some clearly temporary code in pipe_base (basically, we'll need to special-case both calibration lookups and refcat lookups in QG generation), and it will defer the big QG gen optimization until later as well. I suspect this ticket would yield at most modest improvements to QG gen performance, but it would still include the big schema and calibration-certification changes, and that means it's still worth landing as soon as possible, given that most of it is already done.

            Show
            jbosch Jim Bosch added a comment - I think I see a path towards merging this before implementing much of the query/dimensions changes prototyped on DM-26336 . That will leave some clearly temporary code in pipe_base (basically, we'll need to special-case both calibration lookups and refcat lookups in QG generation), and it will defer the big QG gen optimization until later as well. I suspect this ticket would yield at most modest improvements to QG gen performance, but it would still include the big schema and calibration-certification changes, and that means it's still worth landing as soon as possible, given that most of it is already done.
            jbosch Jim Bosch made changes -
            Story Points 12
            gruendl Robert Gruendl [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 25772 ]
            jbosch Jim Bosch made changes -
            Link This issue blocks DM-26686 [ DM-26686 ]
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]
            Hide
            jbosch Jim Bosch added a comment -

            Calling this done as its child tickets are done.  The QG generation optimization work once planned for this ticket will happen on DM-26692.

            Show
            jbosch Jim Bosch added a comment - Calling this done as its child tickets are done.  The QG generation optimization work once planned for this ticket will happen on DM-26692 .
            yusra Yusra AlSayyad made changes -
            Epic Link DM-26786 [ 439736 ]

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.