Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-21898

Create command-line tools for Gen3 repo administration

    XMLWordPrintable

    Details

    • Story Points:
      0
    • Sprint:
      DB_F20_09, DB_S21_12, DB_F21_06, DB_S22_12
    • Team:
      Data Access and Database
    • Urgent?:
      No

      Description

      This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:

      • repo creation (makeButlerRepo.py exists, but may need polish/updates)
      • Gen2 repo conversion
      • skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
      • visit definition (will be split off from ingest in the future)
      • raw ingest
      • repo subset
      • common Registry queries
      • remove collections
      • manage master calibration collections
      • remove dataset types that have been registered (likely used when a mistake has happened)

      Actual work should go on new tickets.

        Attachments

          Issue Links

            Activity

            jbosch Jim Bosch created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Link This issue is blocked by DM-15257 [ DM-15257 ]
            krzys Krzysztof Findeisen made changes -
            Link This issue relates to DM-21915 [ DM-21915 ]
            jbosch Jim Bosch made changes -
            Labels gen3-middleware gen2-deprecation-blocker gen3-middleware
            tjenness Tim Jenness made changes -
            Watchers Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust [ Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust ] Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust, Nate Pease [ Andy Salnikov, Jim Bosch, Michelle Gower, Nate Lust, Nate Pease ]
            npease Nate Pease [X] (Inactive) made changes -
            Link This issue relates to DM-24245 [ DM-24245 ]
            npease Nate Pease [X] (Inactive) made changes -
            Link This issue relates to DM-24329 [ DM-24329 ]
            npease Nate Pease [X] (Inactive) made changes -
            Link This issue relates to DM-24330 [ DM-24330 ]
            tjenness Tim Jenness made changes -
            Story Points 20 0
            gruendl Robert Gruendl [X] (Inactive) made changes -
            Remote Link This issue links to "Page (Confluence)" [ 25783 ]
            npease Nate Pease [X] (Inactive) made changes -
            Assignee Nate Pease [ npease ]
            npease Nate Pease [X] (Inactive) made changes -
            Epic Link DM-25244 [ 435560 ]
            npease Nate Pease [X] (Inactive) made changes -
            Sprint DB_F20_09 [ 1048 ]
            Team Data Release Production [ 10301 ] Data Access and Database [ 10204 ]
            Urgent? off
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26684 [ DM-26684 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26685 [ DM-26685 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26686 [ DM-26686 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26688 [ DM-26688 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26689 [ DM-26689 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26690 [ DM-26690 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-26691 [ DM-26691 ]
            nlust Nate Lust made changes -
            Description This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:
             * repo creation (makeButlerRepo.py exists, but may need polish/updates)
             * Gen2 repo conversion
             * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
             * visit definition (will be split off from ingest in the future)
             * raw ingest
             * repo subset
             * common Registry queries
             * remove collections
             * manage master calibration collections{color:#000000}
            {color}

            Actual work should go on new tickets.
            This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:
             * repo creation (makeButlerRepo.py exists, but may need polish/updates)
             * Gen2 repo conversion
             * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
             * visit definition (will be split off from ingest in the future)
             * raw ingest
             * repo subset
             * common Registry queries
             * remove collections
             * manage master calibration collections{color:#000000}
            * remove dataset types that have been registered (likely used when a mistake has happened)
            {color}

            Actual work should go on new tickets.
            nlust Nate Lust made changes -
            Description This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:
             * repo creation (makeButlerRepo.py exists, but may need polish/updates)
             * Gen2 repo conversion
             * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
             * visit definition (will be split off from ingest in the future)
             * raw ingest
             * repo subset
             * common Registry queries
             * remove collections
             * manage master calibration collections{color:#000000}
            * remove dataset types that have been registered (likely used when a mistake has happened)
            {color}

            Actual work should go on new tickets.
            This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:
             * repo creation (makeButlerRepo.py exists, but may need polish/updates)
             * Gen2 repo conversion
             * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
             * visit definition (will be split off from ingest in the future)
             * raw ingest
             * repo subset
             * common Registry queries
             * remove collections
             * manage master calibration collections{color:#000000}
             * remove dataset types that have been registered (likely used when a mistake has happened)
            {color}

            Actual work should go on new tickets.
            nlust Nate Lust made changes -
            Description This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:
             * repo creation (makeButlerRepo.py exists, but may need polish/updates)
             * Gen2 repo conversion
             * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
             * visit definition (will be split off from ingest in the future)
             * raw ingest
             * repo subset
             * common Registry queries
             * remove collections
             * manage master calibration collections{color:#000000}
             * remove dataset types that have been registered (likely used when a mistake has happened)
            {color}

            Actual work should go on new tickets.
            This is an umbrella ticket for creating (or polishing) command-line repo administration tools for operations that don't involve running PipelineTasks.  These may include:
             * repo creation (makeButlerRepo.py exists, but may need polish/updates)
             * Gen2 repo conversion
             * skymap registration (makeSkyMapGen3.py exists, but may need polish/updates)
             * visit definition (will be split off from ingest in the future)
             * raw ingest
             * repo subset
             * common Registry queries
             * remove collections
             * manage master calibration collections
             * remove dataset types that have been registered (likely used when a mistake has happened)
            {color}

            Actual work should go on new tickets.
            nlust Nate Lust made changes -
            Link This issue relates to DM-26600 [ DM-26600 ]
            tjenness Tim Jenness made changes -
            Remote Link This issue links to "Page (Confluence)" [ 25783 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-26856 [ DM-26856 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-25244 [ 435560 ] DM-27791 [ 442307 ]
            fritzm Fritz Mueller made changes -
            Sprint DB_F20_09 [ 1048 ] DB_F20_09, DB_S21_12 [ 1048, 1065 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-27791 [ 442307 ] DM-30609 [ 511856 ]
            fritzm Fritz Mueller made changes -
            Sprint DB_F20_09, DB_S21_12 [ 1048, 1065 ] DB_F20_09, DB_S21_12, DB_F21_06 [ 1048, 1065, 1103 ]
            fritzm Fritz Mueller made changes -
            Epic Link DM-30609 [ 511856 ] DM-30628 [ 513191 ]
            fritzm Fritz Mueller made changes -
            Sprint DB_F20_09, DB_S21_12, DB_F21_06 [ 1048, 1065, 1103 ] DB_F20_09, DB_S21_12, DB_F21_06, DB_S22_12 [ 1048, 1065, 1103, 1136 ]
            npease Nate Pease [X] (Inactive) made changes -
            Link This issue relates to DM-34887 [ DM-34887 ]
            npease Nate Pease [X] (Inactive) made changes -
            Link This issue relates to DM-34888 [ DM-34888 ]
            npease Nate Pease [X] (Inactive) made changes -
            Resolution Done [ 10000 ]
            Status To Do [ 10001 ] Won't Fix [ 10405 ]

              People

              Assignee:
              npease Nate Pease [X] (Inactive)
              Reporter:
              jbosch Jim Bosch
              Watchers:
              Andy Salnikov, Christopher Waters, Jim Bosch, Michelle Gower, Nate Lust, Nate Pease [X] (Inactive), Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.