Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26692

Materialize dimension spatial relationships and overhaul query system, step 1

    XMLWordPrintable

    Details

    • Story Points:
      18
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Materialize spatial relationships in join tables when dimension records are added, rather than do extra joins at query time. This will require user code to declare which relationships are of interest, which is a small burden on users that relieves a much larger burden on Registry cleverness.

      We also need to overhaul the query system to support these table. This has been prototyped on DM-26336, and will hopefully be the final big piece of optimizing QuantumGraph generation.

        Attachments

          Issue Links

            Activity

            Hide
            tjenness Tim Jenness added a comment -

            Jim Bosch is this blocker ticket complete?

            Show
            tjenness Tim Jenness added a comment - Jim Bosch is this blocker ticket complete?
            Hide
            jbosch Jim Bosch added a comment -

            I was planning to keep adding subtask tickets to do the work beyond just the schema changes part of it, but the schema changes parts are done so it doesn't need to be a blocker anymore.  We can either make DM-27033 the blocker instead of this, or we can redefine and close this and I can open a new ticket for the rest of the work.  Up to you.

            Show
            jbosch Jim Bosch added a comment - I was planning to keep adding subtask tickets to do the work beyond just the schema changes part of it, but the schema changes parts are done so it doesn't need to be a blocker anymore.  We can either make DM-27033 the blocker instead of this, or we can redefine and close this and I can open a new ticket for the rest of the work.  Up to you.
            Hide
            tjenness Tim Jenness added a comment -

            Ok. I'll leave this as is but replace the confluence entry with 27033.

            Show
            tjenness Tim Jenness added a comment - Ok. I'll leave this as is but replace the confluence entry with 27033.
            Hide
            yusra Yusra AlSayyad added a comment -

            Because this super-ticket contains the story points and is what's attached to the epic (whereas the subtasks can't), it makes the accounting harder to keep this ticket open for too much past the end of the month. 

            Show
            yusra Yusra AlSayyad added a comment - Because this super-ticket contains the story points and is what's attached to the epic (whereas the subtasks can't), it makes the accounting harder to keep this ticket open for too much past the end of the month. 
            Hide
            jbosch Jim Bosch added a comment -

            Ok, I've updated the story points here (needed a big bump!) to reflect what has been done already, put it in the f20b-drp-gen3 Epic, and adjusted the title and description accordingly. I'll close shortly and open a new ticket for remaining work.

            I'll also go look for other recently-closed-by-me issues that probably didn't have the epic set.

            Show
            jbosch Jim Bosch added a comment - Ok, I've updated the story points here (needed a big bump!) to reflect what has been done already, put it in the f20b-drp-gen3 Epic, and adjusted the title and description accordingly. I'll close shortly and open a new ticket for remaining work. I'll also go look for other recently-closed-by-me issues that probably didn't have the epic set.
            Hide
            jbosch Jim Bosch added a comment -

            Remaining-work ticket is DM-27660. This one is closed, but there are still some related branches floating out there containing work-in-progress code that I don't want to delete yet.

            Show
            jbosch Jim Bosch added a comment - Remaining-work ticket is DM-27660 . This one is closed, but there are still some related branches floating out there containing work-in-progress code that I don't want to delete yet.

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Jim Bosch, Tim Jenness, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.