Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27790

S21 Qserv Ingest Improvements

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Qserv
    • Labels:
      None
    • Epic Name:
      S21 Qserv Ingest Improvements
    • Story Points:
      20
    • WBS:
      02C.06.02.03
    • Team:
      Data Access and Database
    • Cycle:
      Spring 2021

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      DM-29994

      Migrate package qserv_testdata to support the new Qserv ingest system

      Igor Gaponenko Done
       
      DM-29880

      Incorrect algorithm for configuring director table keys for dependent tables during catalog ingests

      Igor Gaponenko Done
       
      DM-29860

      Fix a race condition in the Qserv Ingest worker

      Igor Gaponenko Done
       
      DM-29725

      Incorrect definitions of the command-line parameters in qserv-replica-config

      Igor Gaponenko Done
       
      DM-29717

      Improved connection management for the MySQL services in the Qserv Replication system

      Igor Gaponenko Done
       
      DM-29438

      Database password specified in the configuration URL is ignored by the Replication system

      1 Igor Gaponenko Done
       
      DM-30099

      Fix a bug in the table removal REST service

      Igor Gaponenko Done
       
      DM-30095

      No transaction contribution bookkeeping made when ingesting files via the binary protocol

      Igor Gaponenko Done
       
      DM-28860

      Refactoring the configuration service of the Qserv Replication/Ingest system

      1 Igor Gaponenko Done
       
      DM-27240

      Master controller crashes in XRootD stack

      4 Igor Gaponenko Done
       
      DM-28490

      Qserv Replication controller crashes if no DNS entry exists for the MySQL service

      0.25 Igor Gaponenko Done
       
      DM-28812

      Lost connection to MySQL server during query in Qserv Ingest service

      0.5 Igor Gaponenko Done
       
      DM-28606

      Retrying connections to the XROOTD services from the Qserv Replication system

      4 Igor Gaponenko Done
       
      DM-28603

      More efficient implementation of the Replication/Ingest algorithms in Qserv

      3 Igor Gaponenko Done
       
      DM-27855

      Lockups in the controller-workers protocol of the Qserv Replication system

      6 Igor Gaponenko Done
       
      DM-27772

      Improved error reporting in the ingest worker for failures when opening/reading table contributions

      1 Igor Gaponenko Done
       
      DM-27681

      Reinforce table management operations in the Ingest worker services

      5 Igor Gaponenko Done
       
      DM-28047

      Master Replication Controller crashes when updating replica info in the database

      3 Igor Gaponenko Done
       
      DM-28008

      Fix a configuration of the partitioner in the Qserv integration test

      2 Igor Gaponenko Done
       
      DM-28006

      Improved error reporting in the ingest worker for failures when pulling files from HTTP/HTTPS servers

      2 Igor Gaponenko Done
       
      DM-25901

      Consolidating 32 replication tools into fewer command-line applications

      2 Igor Gaponenko Done
       
      DM-26172

      Add context for the super-transactions in the Qserv Ingest system

      4 Igor Gaponenko Done
       
      DM-26101

      Add bookkeeping for table contributions requested during catalog ingests

      8 Igor Gaponenko Done
       
      DM-2523

      Ensure we can delete/create table with the same name

      4 Igor Gaponenko Done

        Activity

        fritzm Fritz Mueller created issue -
        fritzm Fritz Mueller made changes -
        Field Original Value New Value
        Epic Child DM-26172 [ 438226 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-26101 [ 437858 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-19631 [ 275178 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-26141 [ 437927 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27681 [ 442016 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-19629 [ 275158 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27772 [ 442227 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-25901 [ 437341 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27240 [ 440718 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-24052 [ 432570 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27396 [ 441130 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27695 [ 442076 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-27855 [ 442439 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28006 [ 442816 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28008 [ 442818 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28010 [ 442821 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28047 [ 442895 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28183 [ 443317 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28433 [ 446561 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28490 [ 447625 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-2523 [ 17172 ]
        fritzm Fritz Mueller made changes -
        WBS 02C.06.02.03
        fritzm Fritz Mueller made changes -
        Status To Do [ 10001 ] In Progress [ 3 ]
        fritzm Fritz Mueller made changes -
        Story Points 20
        gapon Igor Gaponenko made changes -
        Epic Child DM-28603 [ 449281 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28606 [ 449290 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28626 [ 449524 ]
        fritzm Fritz Mueller made changes -
        Rank Ranked higher
        fritzm Fritz Mueller made changes -
        Rank Ranked higher
        gapon Igor Gaponenko made changes -
        Epic Child DM-28812 [ 451676 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-28860 [ 452506 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29293 [ 461430 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29300 [ 461511 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29438 [ 464027 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29447 [ 464307 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29625 [ 468699 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29717 [ 470489 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29725 [ 470573 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29758 [ 471161 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29860 [ 474531 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29880 [ 475595 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29882 [ 475849 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29954 [ 479362 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-29994 [ 482604 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30095 [ 486100 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30099 [ 487556 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30102 [ 487614 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30103 [ 487710 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30184 [ 490324 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30201 [ 490898 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30213 [ 491177 ]
        gapon Igor Gaponenko made changes -
        Epic Child DM-30221 [ 491700 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29625 [ 468699 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29300 [ 461511 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29447 [ 464307 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-30103 [ 487710 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-24052 [ 432570 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-19631 [ 275178 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29954 [ 479362 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27396 [ 441130 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-30201 [ 490898 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29758 [ 471161 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-30102 [ 487614 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-28183 [ 443317 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-30213 [ 491177 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-28010 [ 442821 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-27695 [ 442076 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-28626 [ 449524 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-30184 [ 490324 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-28433 [ 446561 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-26141 [ 437927 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-19629 [ 275158 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29882 [ 475849 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-30221 [ 491700 ]
        fritzm Fritz Mueller made changes -
        Epic Child DM-29293 [ 461430 ]
        fritzm Fritz Mueller made changes -
        Resolution Done [ 10000 ]
        Status In Progress [ 3 ] Done [ 10002 ]
        fritzm Fritz Mueller made changes -
        Epic Status To Do [ 10101 ] Done [ 10103 ]

          People

          Assignee:
          Unassigned Unassigned
          Reporter:
          fritzm Fritz Mueller
          Watchers:
          Fritz Mueller
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

            Dates

            Created:
            Updated:
            Resolved:

              Summary Panel

                CI Builds

                No builds found.