Details
-
Type:
Story
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: daf_butler
-
Story Points:12
-
Epic Link:
-
Team:Data Release Production
Description
See https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization; this should move the schema from something like the "Partition datasets (only)" to the final design on that page.
Superseded by https://confluence.lsstcorp.org/display/DM/Architectural+Prototype+for+the+New+Gen3+Registry (which is not that different). Goal of this ticket is now to make runs a type of collection; this involves:
- requiring registration for new tagged collections as well as runs;
- giving the (recursive) tagged collection associated with a processing run a different name than the run-collection. This will probably be the responsibility of pipetask rather than Butler.
This will add the general framework that will let us add more types of collections later (calibration collections and maybe virtual collections), but we won't actually do that here.
Attachments
Issue Links
- blocks
-
- Done
- is contained by
-
- Done
- is duplicated by
-
- Invalid
- is triggered by
-
- Implemented
- is triggering
-
DM-25016 DM-21724 unpickling error appears again
- Done
-
- Done
- relates to
-
- To Do
Activity
| Labels | gen3-middleware | gen2-deprecation-blocker gen3-middleware |
| Summary | Add specialized uniqueness for collections and dataset types | Make runs a type of collection |
| Description |
See [https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization|https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization;]; this should move the schema from something like the "Partition datasets (only)" to the final design on that page.
|
-See [https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization|https://confluence.lsstcorp.org/display/DM/Dataset+and+Collection+Table+Reorganization;]; this should move the schema from something like the "Partition datasets (only)" to the final design on that page.-
Superseded by [https://confluence.lsstcorp.org/display/DM/Architectural+Prototype+for+the+New+Gen3+Registry] (which is not that different). Goal of this ticket is now to make runs a type of collection; this involves: * requiring registration for new tagged collections as well as runs; * giving the (recursive) tagged collection associated with a processing run a different name than the run-collection. This will probably be the responsibility of {{pipetask}} rather than Butler. This will add the general framework that will let us add more types of collections later (calibration collections and maybe virtual collections), but we won't actually do that here. |
| Status | To Do [ 10001 ] | In Progress [ 3 ] |
| Story Points | 4 | 12 |
| Resolution | Done [ 10000 ] | |
| Status | In Progress [ 3 ] | Done [ 10002 ] |
Hsin-Fang Chiang
made changes -