Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-17608

Fix performance regression from SQLite transaction changes

    Details

      Description

      DM-17495 fixed the deadlocks we saw in SQLite Registries at the expense of adding much more aggressive locking.  That has caused a pretty dramatic slowdown in operations that make a large number of Registry calls without first starting an explicit transaction, at least on GPFS (because this results in many small transactions, and hence many lock/unlock calls in sequence).

      A simple workaround for this (which may also be the best we can do long-term for SQLite) is to wrap such calls in an explicit transaction; that needs to be done now for gen2convert (the only tool we have right now that does not use explicit transactions) to fix a serious regression in ci_hsc performance.

        Attachments

          Activity

          There are no comments yet on this issue.

            People

            • Assignee:
              jbosch Jim Bosch
              Reporter:
              jbosch Jim Bosch
              Reviewers:
              Nate Lust
              Watchers:
              Jim Bosch, Nate Lust
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Summary Panel