Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24432

Add CALIBRATION collections and remove the calibration_label dimension

    XMLWordPrintable

Details

    • 12
    • Data Release Production
    • No

    Description

      As per the prototype, add CALIBRATION-type collections that include a validity range in associations, and remove the calibration_label dimension. Update downstream code.

      Attachments

        Issue Links

          There are no Sub-Tasks for this issue.

          Activity

            jbosch Jim Bosch added a comment -

            Started this because it was both the tallest pole in the QG generation profiles and a schema change. But now I think I'm going to go do DM-24938 first, as that'll inform how I want to structure the tables to make sure the lookups in QG generation are fast. There is a branch here, but it just adds an enum value and documentation for it.

            jbosch Jim Bosch added a comment - Started this because it was both the tallest pole in the QG generation profiles and a schema change. But now I think I'm going to go do DM-24938 first, as that'll inform how I want to structure the tables to make sure the lookups in QG generation are fast. There is a branch here, but it just adds an enum value and documentation for it.
            jbosch Jim Bosch added a comment -

            I think I see a path towards merging this before implementing much of the query/dimensions changes prototyped on DM-26336. That will leave some clearly temporary code in pipe_base (basically, we'll need to special-case both calibration lookups and refcat lookups in QG generation), and it will defer the big QG gen optimization until later as well. I suspect this ticket would yield at most modest improvements to QG gen performance, but it would still include the big schema and calibration-certification changes, and that means it's still worth landing as soon as possible, given that most of it is already done.

            jbosch Jim Bosch added a comment - I think I see a path towards merging this before implementing much of the query/dimensions changes prototyped on DM-26336 . That will leave some clearly temporary code in pipe_base (basically, we'll need to special-case both calibration lookups and refcat lookups in QG generation), and it will defer the big QG gen optimization until later as well. I suspect this ticket would yield at most modest improvements to QG gen performance, but it would still include the big schema and calibration-certification changes, and that means it's still worth landing as soon as possible, given that most of it is already done.
            jbosch Jim Bosch added a comment -

            Calling this done as its child tickets are done.  The QG generation optimization work once planned for this ticket will happen on DM-26692.

            jbosch Jim Bosch added a comment - Calling this done as its child tickets are done.  The QG generation optimization work once planned for this ticket will happen on DM-26692 .

            People

              jbosch Jim Bosch
              jbosch Jim Bosch
              Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.