Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21795

Rework Registry provenance objects to match prototype

    XMLWordPrintable

    Details

      Description

      (original description is no longer accurate; see comments)

      Registry's provenance tables - execution, run, and quantum - can't currently be fully populated without having database updates.  For example:

      • you can't insert a dataset until after its run has been inserted;
      • you can't insert a run until you've inserted the execution it inherits its ID from;
      • you can't insert an execution until after it's completed, because it has an end timestamp field.

      Work through low-level use cases for these tables and ensure we can actually have all of their values when it's time to insert them, splitting up tables as necessary.

      Michelle Gower, Christopher Stephens [X]: this ticket exists because I'm assuming updates are a problem.  Please let me know if they aren't or if you have any expections/requirements/wisdom on when various provenance records should be inserted relative to the datasets they refer to.

        Attachments

          Issue Links

            Activity

            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Epic Link DM-21254 [ 414685 ]
            jbosch Jim Bosch made changes -
            Link This issue is contained by DM-21231 [ DM-21231 ]
            jbosch Jim Bosch made changes -
            Labels gen3-middleware gen2-deprecation-blocker gen3-middleware
            jbosch Jim Bosch made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            jbosch Jim Bosch made changes -
            Summary Rework Registry provenance tables to match insert order Rework Registry provenance objects to match prototype
            jbosch Jim Bosch made changes -
            Description Registry's provenance tables - execution, run, and quantum - can't currently be fully populated without having database updates.  For example:
             * you can't insert a dataset until after its run has been inserted;
             * you can't insert a run until you've inserted the execution it inherits its ID from;
             * you can't insert an execution until after it's completed, because it has an end timestamp field.

            Work through low-level use cases for these tables and ensure we can actually have all of their values when it's time to insert them, splitting up tables as necessary.

            [~mgower], [~cs2018]: this ticket exists because I'm assuming updates are a problem.  Please let me know if they aren't or if you have any expections/requirements/wisdom on when various provenance records should be inserted relative to the datasets they refer to.
            (original description is no longer accurate; see comments)

            -Registry's provenance tables - execution, run, and quantum - can't currently be fully populated without having database updates.  For example:-
             * -you can't insert a dataset until after its run has been inserted;-
             * -you can't insert a run until you've inserted the execution it inherits its ID from;-
             * -you can't insert an execution until after it's completed, because it has an end timestamp field.-

            -Work through low-level use cases for these tables and ensure we can actually have all of their values when it's time to insert them, splitting up tables as necessary.-

            [~mgower]-,- [~cs2018]-: this ticket exists because I'm assuming updates are a problem.  Please let me know if they aren't or if you have any expections/requirements/wisdom on when various provenance records should be inserted relative to the datasets they refer to.-
            jbosch Jim Bosch made changes -
            Story Points 3 2
            jbosch Jim Bosch made changes -
            Reviewers Mikolaj Kowalik [ mkowalik ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            mkowalik Mikolaj Kowalik made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            jbosch Jim Bosch made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Mikolaj Kowalik
              Watchers:
              Christopher Stephens [X] (Inactive), Jim Bosch, Mikolaj Kowalik
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.