Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21898

Create command-line tools for Gen3 repo administration

    XMLWordPrintable

    Details

    • Story Points:
      0
    • Epic Link:
    • Sprint:
      DB_F20_09, DB_S21_12, DB_F21_06, DB_S22_12
    • Team:
      Data Access and Database
    • Urgent?:
      No

      Description

      This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:

      • repo creation (makeButlerRepo.py exists, but may need polish/updates)
      • Gen2 repo conversion
      • skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
      • visit definition (will be split off from ingest in the future)
      • raw ingest
      • repo subset
      • common Registry queries
      • remove collections
      • manage master calibration collections
      • remove dataset types that have been registered (likely used when a mistake has happened)

      Actual work should go on new tickets.

        Attachments

          Issue Links

          is blocked by

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-15257 Refactor argument parsing to work with drivers that aren't CmdLineTask

          • Won't Fix
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26686 Add command-line tools for Registry.decertify.

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26691 Add command-line tool for Butler.export

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-34888 add a butler command to list a calibration collection

          • To Do

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-24245 Convert daf_butler script to Click as a test for that package.

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-24329 add sphinx documentation of the Click CLI in daf_butler

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-24330 add ability to run an obs_base command via the butler command

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26600 Add ability to prune erroneous datasetTypes from gen3 registry

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26684 Add command-line tool for Butler.pruneCollection

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26688 Add command-line tool for Registry.associate

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26689 Add command-line tool for Butler.pruneDatasets

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26690 Add command-line tool for Registry.queryDataIds

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26856 Add butler remove-dataset-type command line subcommand

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-34887 add support to butler transfer-datasets to also transfer the dimension records it needs

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21915 Support Gen 3 ingestion of ap_verify datasets

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-26685 Add command-line tool for Registry.queryDatasets

          • Done

            Activity

            No work has yet been logged on this issue.

              People

              Assignee:
              npease Nate Pease [X] (Inactive)
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Andy Salnikov, Christopher Waters, Jim Bosch, Michelle Gower, Nate Lust, Nate Pease [X] (Inactive), Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.