Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-37249

Make butler registry compatible with transaction-level connection pooling

    XMLWordPrintable

    Details

    • Story Points:
      4
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Try to use transactions to manage temporary table lifetimes instead of connections, to bring us into compatibility with pgbounder's "transaction" mode:

      https://www.pgbouncer.org/features.html

      Need to think about what this does to result cursors.

        Attachments

          Activity

          Hide
          czw Christopher Waters added a comment -

          I'm somewhat surprised I haven't noticed any issues before (I usually use -j8 when running ci_cpp_gen3 manually), but I have no problem making it more reliable.

          Show
          czw Christopher Waters added a comment - I'm somewhat surprised I haven't noticed any issues before (I usually use  -j8 when running ci_cpp_gen3 manually), but I have no problem making it more reliable.
          Hide
          jbosch Jim Bosch added a comment -

          v25 backport is complete, but v24 will require a bit more work as there were some conflicts to resolve.  I did not backport the ci_cpp_gen3 branch as it appears we haven't ever tagged that for release.

          Show
          jbosch Jim Bosch added a comment - v25 backport is complete, but v24 will require a bit more work as there were some conflicts to resolve.  I did not backport the ci_cpp_gen3 branch as it appears we haven't ever tagged that for release.
          Hide
          tjenness Tim Jenness added a comment -

          I've added the right group to ci_cpp_gen3 so it should start getting tags. It wasn't getting weekly tags either. I've added the 24 and 25 release tags.

          Show
          tjenness Tim Jenness added a comment - I've added the right group to ci_cpp_gen3 so it should start getting tags. It wasn't getting weekly tags either. I've added the 24 and 25 release tags.
          Hide
          jbosch Jim Bosch added a comment -

          Thanks.  I've just added the v25.0.x branch to ci_cpp_gen3 at main, since this ticket is the only one to land on that package since the initial v25 tag and hence that accomplishes the backport; I don't see a good reason to create a new backport and merge commit for that (but I can I can do it if you think it'd be better).

          Show
          jbosch Jim Bosch added a comment - Thanks.  I've just added the v25.0.x branch to ci_cpp_gen3 at main, since this ticket is the only one to land on that package since the initial v25 tag and hence that accomplishes the backport; I don't see a good reason to create a new backport and merge commit for that (but I can I can do it if you think it'd be better).
          Hide
          tjenness Tim Jenness added a comment -

          Creating the branch on HEAD of main is absolutely fine.

          Show
          tjenness Tim Jenness added a comment - Creating the branch on HEAD of main is absolutely fine.

            People

            Assignee:
            jbosch Jim Bosch
            Reporter:
            jbosch Jim Bosch
            Reviewers:
            Christopher Waters
            Watchers:
            Andy Salnikov, Christopher Waters, Jim Bosch, Tim Jenness
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.