Details
-
Type:
Story
-
Status: Won't Fix
-
Resolution: Done
-
Fix Version/s: None
-
Component/s: daf_butler, obs_base
-
Story Points:0
-
Epic Link:
-
Sprint:DB_F20_09, DB_S21_12, DB_F21_06, DB_S22_12
-
Team:Data Access and Database
-
Urgent?:No
Description
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
- repo creation (makeButlerRepo.py exists, but may need polish/updates)
- Gen2 repo conversion
- skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
- visit definition (will be split off from ingest in the future)
- raw ingest
- repo subset
- common Registry queries
- remove collections
- manage master calibration collections
- remove dataset types that have been registered (likely used when a mistake has happened)
Actual work should go on new tickets.
Attachments
Issue Links
- is blocked by
-
DM-15257 Refactor argument parsing to work with drivers that aren't CmdLineTask
- Won't Fix
- relates to
-
DM-26686 Add command-line tools for Registry.decertify.
- To Do
-
DM-26691 Add command-line tool for Butler.export
- To Do
-
DM-34888 add a butler command to list a calibration collection
- To Do
-
DM-24245 Convert daf_butler script to Click as a test for that package.
- Done
-
DM-24329 add sphinx documentation of the Click CLI in daf_butler
- Done
-
DM-24330 add ability to run an obs_base command via the butler command
- Done
-
DM-26600 Add ability to prune erroneous datasetTypes from gen3 registry
- Done
-
DM-26684 Add command-line tool for Butler.pruneCollection
- Done
-
DM-26688 Add command-line tool for Registry.associate
- Done
-
DM-26689 Add command-line tool for Butler.pruneDatasets
- Done
-
DM-26690 Add command-line tool for Registry.queryDataIds
- Done
-
DM-26856 Add butler remove-dataset-type command line subcommand
- Done
-
DM-34887 add support to butler transfer-datasets to also transfer the dimension records it needs
- Done
-
DM-21915 Support Gen 3 ingestion of ap_verify datasets
- Done
-
DM-26685 Add command-line tool for Registry.queryDatasets
- Done
Activity
Labels | gen3-middleware | gen2-deprecation-blocker gen3-middleware |
Watchers | Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust [ Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust ] | Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust, Nate Pease [ Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust, Nate Pease ] |
Story Points | 20 | 0 |
Remote Link | This issue links to "Page (Confluence)" [ 25783 ] |
Assignee | Nate Pease [ npease ] |
Epic Link |
|
Sprint | DB_F20_09 [ 1048 ] | |
Team | Data Release Production [ 10301 ] | Data Access and Database [ 10204 ] |
Urgent? | off |
Description |
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
* repo creation (makeButlerRepo.py exists, but may need polish/updates) * Gen2 repo conversion * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates) * visit definition (will be split off from ingest in the future) * raw ingest * repo subset * common Registry queries * remove collections * manage master calibration collections{color:#000000} {color} Actual work should go on new tickets. |
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
* repo creation (makeButlerRepo.py exists, but may need polish/updates) * Gen2 repo conversion * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates) * visit definition (will be split off from ingest in the future) * raw ingest * repo subset * common Registry queries * remove collections * manage master calibration collections{color:#000000} * remove dataset types that have been registered (likely used when a mistake has happened) {color} Actual work should go on new tickets. |
Description |
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
* repo creation (makeButlerRepo.py exists, but may need polish/updates) * Gen2 repo conversion * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates) * visit definition (will be split off from ingest in the future) * raw ingest * repo subset * common Registry queries * remove collections * manage master calibration collections{color:#000000} * remove dataset types that have been registered (likely used when a mistake has happened) {color} Actual work should go on new tickets. |
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
* repo creation (makeButlerRepo.py exists, but may need polish/updates) * Gen2 repo conversion * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates) * visit definition (will be split off from ingest in the future) * raw ingest * repo subset * common Registry queries * remove collections * manage master calibration collections{color:#000000} * remove dataset types that have been registered (likely used when a mistake has happened) {color} Actual work should go on new tickets. |
Description |
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
* repo creation (makeButlerRepo.py exists, but may need polish/updates) * Gen2 repo conversion * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates) * visit definition (will be split off from ingest in the future) * raw ingest * repo subset * common Registry queries * remove collections * manage master calibration collections{color:#000000} * remove dataset types that have been registered (likely used when a mistake has happened) {color} Actual work should go on new tickets. |
This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks. These may include:
* repo creation (makeButlerRepo.py exists, but may need polish/updates) * Gen2 repo conversion * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates) * visit definition (will be split off from ingest in the future) * raw ingest * repo subset * common Registry queries * remove collections * manage master calibration collections * remove dataset types that have been registered (likely used when a mistake has happened) {color} Actual work should go on new tickets. |
Remote Link | This issue links to "Page (Confluence)" [ 25783 ] |
Sprint | DB_F20_09 [ 1048 ] | DB_F20_09, DB_S21_12 [ 1048, 1065 ] |
Sprint | DB_F20_09, DB_S21_12 [ 1048, 1065 ] | DB_F20_09, DB_S21_12, DB_F21_06 [ 1048, 1065, 1103 ] |
Sprint | DB_F20_09, DB_S21_12, DB_F21_06 [ 1048, 1065, 1103 ] | DB_F20_09, DB_S21_12, DB_F21_06, DB_S22_12 [ 1048, 1065, 1103, 1136 ] |
Resolution | Done [ 10000 ] | |
Status | To Do [ 10001 ] | Won't Fix [ 10405 ] |
Nate Pease [X] this is the umbrella ticket for all the command line tool work. If you could link to this ticket with a RelatesTo link that would be good. I don't think this ticket needs to be assigned to you since it's highly likely no work will be done on this directly.