Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-24515

Refactor gen3 butler.prune

    XMLWordPrintable

    Details

    • Story Points:
      2
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      In DM-23671 we refactored datastore deletion into a two pass trash and empty. This allows us to simplify the logic in prune.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-23671 Improve dataset deletion in Gen3 butler

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            I'm going to take a quick shot at this before proceeding with the dataset table refactor so I can have a bit more confidence in the dataset-deletion APIs I'll be moving around there.

            Show
            jbosch Jim Bosch added a comment - I'm going to take a quick shot at this before proceeding with the dataset table refactor so I can have a bit more confidence in the dataset-deletion APIs I'll be moving around there.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            This goes a bit beyond the original ticket description, because I wanted to do a bit more work to simplify and clarify interfaces prior to the dataset table refactor on DM-21764.

            Andy Salnikov, I hope you don't mind reviewing, even if you haven't been following the deletion discussions too closely - I don't think that will matter much here - as I've been hitting Tim Jenness pretty hard with reviews lately.

            Show
            jbosch Jim Bosch added a comment - This goes a bit beyond the original ticket description, because I wanted to do a bit more work to simplify and clarify interfaces prior to the dataset table refactor on DM-21764 . Andy Salnikov , I hope you don't mind reviewing, even if you haven't been following the deletion discussions too closely - I don't think that will matter much here - as I've been hitting Tim Jenness pretty hard with reviews lately.
            Hide
            Permalink
            jbosch Jim Bosch added a comment -

            Jira has spotted the tiny ctrl_mpexec PR, but not the daf_butler one, so here it is: https://github.com/lsst/daf_butler/pull/261.

            Show
            jbosch Jim Bosch added a comment - Jira has spotted the tiny ctrl_mpexec PR, but not the daf_butler one, so here it is: https://github.com/lsst/daf_butler/pull/261 .
            Hide
            Permalink
            salnikov Andy Salnikov added a comment -

            Sure, will look at it later today when I'm done with one qserv review.

            Show
            salnikov Andy Salnikov added a comment - Sure, will look at it later today when I'm done with one qserv review.
            Hide
            Permalink
            salnikov Andy Salnikov added a comment -

            Looks good, few minor comments.

            Show
            salnikov Andy Salnikov added a comment - Looks good, few minor comments.

              People

              Assignee:
              jbosch Jim Bosch
              Reporter:
              tjenness Tim Jenness
              Reviewers:
              Andy Salnikov
              Watchers:
              Andy Salnikov, Jim Bosch, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.