Details
-
Type:
Epic
-
Status: Done
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: None
-
Labels:
-
Epic Name:s18-mw-butler-1
-
Team:Architecture
Description
Develop the Gen3 Butler components as needed to support running all CmdLineTasks included in ci_hsc, via a testing script that calls their run methods directly (instead of using parseAndRun.
This will require (at least):
- A Butler class capable of supporting at least the get, put, and datasetExists operations. Expected to be developed by a combination of Pim Schellart [X] or Tim Jenness.
- A SQLite-based Registry implementation capable of supporting those operations. Expected to be developed primarily by Pim Schellart [X].
- A local POSIX Datastore implementation capable of supporting those operations. Expected to be developed primarily by Tim Jenness.
- A shim layer that allows these operations to be done with the Gen3 Butler using the Gen2 Butler API (particularly a temporary DataRef class). Expected to be developed primarily by Pim Schellart [X].
- A functional prototype definition of the Registry schema. Initial structure will be developed initially by Jim Bosch according to the general approach agreed at the January Middleware Meeting, with review support and additional content provided by others (especially Michelle Gower).
- A script to allow Gen2 Data Repositories to be loaded into Gen3 Registry databases and accessed by Gen3 Datastores. Expected to be developed primarily by Jim Bosch.
- A functional prototype for the Gen3 Butler's camera-customization interface (i.e. obs* package interface). Expected to be developed primarily by Jim Bosch, in consultation with Simon Krughoff and the obs redesign working group.
- A functional implementation of the Gen3 Butler's camera-customization interface for HSC. Expected to be developed primarily by Jim Bosch.
- Additional Registry/Datastore/shim functionality or minor CmdLineTask changes to support any use of methods beyond get, set, and datasetExists in CmdLineTasks (e.g. use of Butler.subset).
The completion of this epic is the first of two S18 Middleware milestones, with completion criteria the ability to run a custom version of the ci_hsc test package that uses the Gen3 Butler, with minimally modified versions of CmdLineTasks it executes. Our goal is to complete these tests by April 13.
This Epic should be used instead of the existing cycle-wide per-Team Epics by middleware developers members to organize the stories within its scope. Fritz Mueller will handle filling in the per-Team Epics as needed for loading PMCS.
Attachments
Issue Links
Key | Summary | Story Points | Assignee | Status | |
---|---|---|---|---|---|
|
0.5 | Jim Bosch | Done | ||
|
0.5 | Jim Bosch | Done | ||
|
2 | Jim Bosch | Done | ||
|
2 | Jim Bosch | Done | ||
|
0.5 | Tim Jenness | Done | ||
|
8 | Tim Jenness | Done | ||
|
10 | Tim Jenness | Done | ||
|
Move DatasetType template to Datastore configuration (override) |
6 | Tim Jenness | Done | |
|
4 | Tim Jenness | Done | ||
|
0.5 | Pim Schellart [X] (Inactive) | Done | ||
|
Deal with comments from review of LDM-592 from butler gen3 review |
6 | Tim Jenness | Done | |
|
2 | Pim Schellart [X] (Inactive) | Done | ||
|
0.5 | Tim Jenness | Done | ||
|
Add skypix and spatial relationships to Gen2->Gen3 conversion |
4 | Jim Bosch | Done | |
|
1 | Tim Jenness | Done | ||
|
0.5 | Tim Jenness | Done | ||
|
2 | Tim Jenness | Done | ||
|
10 | Tim Jenness | Done | ||
|
6 | Tim Jenness | Done | ||
|
Store Python types with PosixDatastore and remove redundant StorageClasses |
2 | Unassigned | Invalid | |
|
2 | Jim Bosch | Invalid | ||
|
4 | Jim Bosch | Invalid |
Let's set the team on this epic to DAX, on the basis that all epics are required to have a team, and Fritz Mueller is coordinating this work.