Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27033

Integration of pre-middleware-release dimensions changes

    XMLWordPrintable

    Details

    • Story Points:
      3
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      DM-26692 and DM-26407 will be touching some of the same code, but both involve major schema changes. This ticket's branch will be used as an integration branch to allow smaller changes from each ticket to be merged without breaking schema stability constantly on master.

        Attachments

          Issue Links

          blocks

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-27337 Complete Milestone LDM-GEN3 (Gen 3 Parity)

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-24660 Improve Gen3 schema backwards compatibility

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-25180 Add ingest time to registry

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-27390 Replace DimensionGraph.encode with something more stable

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-27397 Drop support for dataset type, governor restrictions in collection chaining

          • Done

          Technical task - Created by JIRA Agile - do not edit or delete. Issue type for a technical task. DM-27034 Overhaul dimension construction and add ABCs

          • Done

          Technical task - Created by JIRA Agile - do not edit or delete. Issue type for a technical task. DM-27035 Streamlining and integration after dimensions overhaul

          • Done

          Technical task - Created by JIRA Agile - do not edit or delete. Issue type for a technical task. DM-27251 Introduce governor dimensions

          • Done

          Technical task - Created by JIRA Agile - do not edit or delete. Issue type for a technical task. DM-27253 Add support for materializing dimension overlaps in old query system

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26407 Change how dimensions are stored in a Butler repository

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26692 Materialize dimension spatial relationships and overhaul query system, step 1

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-27321 Add observing day and other fixes to exposure/visit tables

          • Done
          mentioned in

          Page Loading...

            Activity

            Ascending order - Click to sort in descending order
            5 older comments
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            I've merged tickets/DM-27253 of daf_butler to tickets/DM-27033.  A DM-27253 branch of ci_hsc_gen2 was merged to master.

            I'm currently rebasing DM-27390 on the latest tickets/DM-27033 branch (since there's already a PR out for review, but it looks like the review hasn't been started yet).

            Show
            jbosch Jim Bosch added a comment - I've merged tickets/ DM-27253 of daf_butler to tickets/ DM-27033 .  A DM-27253 branch of ci_hsc_gen2 was merged to master. I'm currently rebasing DM-27390 on the latest tickets/ DM-27033 branch (since there's already a PR out for review, but it looks like the review hasn't been started yet).
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            I've merged DM-27390 to the integration branch, with branches for both daf_butler and ctrl_mpexec.  The ctrl_mpexec changes were just reverting half of the DM-27251 changes to ctrl_mpexec, and I actually plan to revert the rest on DM-27397.  I'm sure Tim Jenness will be delighted to learn that a lot of that ", universe=X" I made him review is now going away; perils of trying to get code out for review early instead of all at once at the end, I guess.

            Show
            jbosch Jim Bosch added a comment - I've merged DM-27390 to the integration branch, with branches for both daf_butler and ctrl_mpexec.  The ctrl_mpexec changes were just reverting half of the DM-27251 changes to ctrl_mpexec, and I actually plan to revert the rest on DM-27397 .  I'm sure Tim Jenness will be delighted to learn that a lot of that ", universe=X" I made him review is now going away; perils of trying to get code out for review early instead of all at once at the end, I guess.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            I've merged tickets/DM-24660 to the integration branch (just daf_butler).  Forgot to wait for Jenkins to finish, but it hasn't failed yet, so hopefully I'll escape unscathed.

            Show
            jbosch Jim Bosch added a comment - I've merged tickets/ DM-24660 to the integration branch (just daf_butler).  Forgot to wait for Jenkins to finish, but it hasn't failed yet, so hopefully I'll escape unscathed.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            I've merged all branches of DM-27397 (daf_butler, obs_base, ctrl_mpexec) to the integration branch.  I added the obs_base branch in response to a Jenkins failure after review (changes were trivial).

            Show
            jbosch Jim Bosch added a comment - I've merged all branches of DM-27397 (daf_butler, obs_base, ctrl_mpexec) to the integration branch.  I added the obs_base branch in response to a Jenkins failure after review (changes were trivial).
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Merged to master.  I'm claiming some story points here because integrating and testing it all did take some effort.

            Show
            jbosch Jim Bosch added a comment - Merged to master.  I'm claiming some story points here because integrating and testing it all did take some effort.

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Andy Salnikov, Jim Bosch, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.