[DM-16221] Avoid full-job transactions in Gen3 ingest - Jira

XML

Word

Printable

Details

Type: Story
Status: Won't Fix
Resolution: Done
Fix Version/s: None
Component/s: daf_butler, obs_base
Labels:
- gen3-middleware

Templates:
customfield_11800 229188
Story Points:
2
Epic Link:
s19a-drp-pipelinetask
Team:
Data Release Production

Description

The Gen3 ingest code currently tries to provide transactionality at a level we probably can't realistically support, which constrains the implementation of some constraints in daf_butler to fragile approaches. Full discussion on ~~DM-16160~~.

Attachments

Issue Links

is duplicated by

DM-16227 Implement collection integrity constraint inside the registry database

Done

relates to

DM-15497 Revisit Registry transactions to prevent non-mutating failures from triggering global rollbacks

Invalid

DM-16160 Fix constraint check in associate method

Done

DM-16159 Revert DM-15686 to un-break obs_subaru master

Done

DM-15686 Re-implement task execution in laptop activator

Done

Activity

Hide

Permalink

Jim Bosch added a comment - 15/Jan/19 3:51 PM

The fact that we've now got true nested transactions on ~~DM-16227~~ makes this a non-issue; no changes are needed to the ingest code (other than to remove the partial workaround we had before, and that's been done on ~~DM-16227~~ as well).

Show

Jim Bosch added a comment - 15/Jan/19 3:51 PM The fact that we've now got true nested transactions on DM-16227 makes this a non-issue; no changes are needed to the ingest code (other than to remove the partial workaround we had before, and that's been done on DM-16227 as well).

People

Assignee:: Jim Bosch

Reporter:: Jim Bosch

Watchers:: Jim Bosch

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 16/Oct/18 4:22 PM

Updated:: 15/Jan/19 3:51 PM

Resolved:: 15/Jan/19 3:51 PM

CI Builds

No builds found.

Data Management