Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33769

Improve timeout, retry and connexion persistence of webDAV client

    XMLWordPrintable

Details

    • External
    • No

    Description

      Some scalability tests against dCache (webDAV) showed that better handling of timeouts and retries were necessary as well as improvements in the management of persistent HTTP connexions to avoid overwhelming the servers when thousands of clients execute simultaneously.

      In this issue I propose modifications to improve the situation and some refactoring for making the code simpler when possible including renaming of environment variables previously named LSST_BUTLER_*.

      Attachments

        Issue Links

          Activity

            FabioHernandez Fabio Hernandez created issue -
            tjenness Tim Jenness made changes -
            Field Original Value New Value
            Team External [ 12117 ]
            FabioHernandez Fabio Hernandez made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            FabioHernandez Fabio Hernandez made changes -
            Reviewers Tim Jenness [ tjenness ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            tjenness Tim Jenness made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            FabioHernandez Fabio Hernandez made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            tjenness Tim Jenness made changes -
            Labels gen3-middleware backport-approved backport-v23 gen3-middleware
            FabioHernandez Fabio Hernandez made changes -
            Resolution Done [ 10000 ]
            Status Done [ 10002 ] To Do [ 10001 ]
            FabioHernandez Fabio Hernandez made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            FabioHernandez Fabio Hernandez made changes -
            Status In Progress [ 3 ] In Review [ 10004 ]
            tjenness Tim Jenness made changes -
            Link This issue relates to DM-34169 [ DM-34169 ]
            FabioHernandez Fabio Hernandez made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            FabioHernandez Fabio Hernandez made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            yusra Yusra AlSayyad made changes -
            Labels backport-approved backport-v23 gen3-middleware backport-approved backport-done backport-v23 gen3-middleware

            People

              FabioHernandez Fabio Hernandez
              FabioHernandez Fabio Hernandez
              Tim Jenness
              Fabio Hernandez, Tim Jenness
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.