Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-26034

Possible race condition in the Qserv worker ingest service

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Qserv
    • Labels:
      None

      Description

      When the new ingest system of Qserv is put under a heavy load with many "super-transactions" open then there is a small chance that worker ingest servers may fail to load table contributions. The following error would be typically returned to a client (and posted in the corresponding worker's log file) should this happen:

      Connection[69]::execute(_inTransaction=1)  mysql_real_query failed, query: 'ALTER TABLE `dc2_run2_1i_dr1b`.`positionFullOverlap_59922` ADD PARTITION IF NOT EXISTS (PARTITION `p195` VALUES IN (195))', error: Deadlock found when trying to get lock; try restarting transaction, errno: 1213
      

      Apparently, there is a race condition in the current implementation of the service.

        Attachments

          Issue Links

            Activity

            Hide
            salnikov Andy Salnikov added a comment -

            I reviewed PR but ticket is still In Progress, feel free to mark it as Done.

            Show
            salnikov Andy Salnikov added a comment - I reviewed PR but ticket is still In Progress, feel free to mark it as Done.

              People

              Assignee:
              gapon Igor Gaponenko
              Reporter:
              gapon Igor Gaponenko
              Reviewers:
              Andy Salnikov
              Watchers:
              Andy Salnikov, Fabrice Jammes, Fritz Mueller, Igor Gaponenko, Nate Pease, Sabine Elles
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: