Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-30610

F21 Qserv Ingest Improvements

    XMLWordPrintable

    Details

    • Type: Epic
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      F21 Qserv Ingest Improvements
    • Story Points:
      10
    • WBS:
      02C.06.02.03
    • Team:
      Data Access and Database
    • Cycle:
      Fall 2021

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
      DM-24052

      Re-ingesting SDSS Stripe82 catalog (all tables) into LSP-INT

      10 Igor Gaponenko To Do
      DM-19631

      Replication of partially ingested catalogs

      30 Igor Gaponenko To Do
      DM-19629

      Prototype ingest workflow

      20 Igor Gaponenko To Do
      DM-30719

      REST service for managing the replication level in Qserv

      Igor Gaponenko To Do
      DM-30687

      Asynchronous protocol for ingesting table contributions in Qserv

      Igor Gaponenko To Do
      DM-30955

      Enhanced monitoring of Qserv workers to report status of data transmission

      Igor Gaponenko To Do
      DM-30885

      Display Qserv instance identifier in the Qserv Web Dashboard

      Igor Gaponenko To Do
      DM-30221

      False-positive stats in the replica scanner algorithm of the Qserv Replication system

      Igor Gaponenko To Do
      DM-30213

      Incorrect implementation of the chunk map in Qserv Web Dashboard

      Igor Gaponenko To Do
      DM-30201

      Improved algorithm for managing MySQL grants when publishing catalogs in the Qserv ingest system

      Igor Gaponenko To Do
      DM-30184

      Incorrect error handling in the replica synchronization algorithms of the Qserv Replication system

      Igor Gaponenko To Do
      DM-30102

      Reinforced implementation of the REST services to prevent race conditions

      Igor Gaponenko To Do
      DM-29954

      Inject chunks disposition into Qserv meta table

      Igor Gaponenko To Do
      DM-29882

      Reinforce the ingest service to block delayed contributions

      Igor Gaponenko To Do
      DM-29758

      Write the Configuration Guide for the Qserv Replication and Ingest system

      Igor Gaponenko To Do
      DM-27695

      Managing engine-independent table statistics in Qserv

      3 Igor Gaponenko To Do
      DM-27396

      Fix a problem with the socket reuse option in QHTTP when running the server inside Docker environment

      Fritz Mueller To Do
      DM-28010

      Update documentation on configuring the partitioning tools

      0.5 Igor Gaponenko To Do
      DM-26141

      Passing connection parameters of the source workers in the replica creation requests

      4 Igor Gaponenko To Do
      DM-29300

      Lock wait timeout exceeded while updating replica info by the Qserv Replication Controller

      Igor Gaponenko To Do
      DM-28433

      Add support for multiple director tables in the Qserv Ingest system

      10 Igor Gaponenko To Do
      DM-28183

      Ingesting table contributions via named pipes at Qserv Ingest workers

      4 Igor Gaponenko To Do
      DM-29625

      Serializing an incomplete protobuf object when cluster identity can't be verified

      1 Igor Gaponenko To Do
      DM-29293

      Improved error processing in the table index creation operation

      2 Igor Gaponenko To Do
      DM-28626

      Allow un-publishing catalogs in the Qserv Replication/Ingest system

      8 Igor Gaponenko To Do
      DM-29447

      Disallow using TEXT/BLOB types in the director tables during catalog ingest

      1 Igor Gaponenko To Do
      DM-30816

      Refined build procedure for the binary containers of the Qserv Replication system

      Igor Gaponenko In Progress
       
      DM-30666

      Streamlined version of the regular tables location service in the Qserv Ingest REST server

      Igor Gaponenko Done
       
      DM-31073

      Database deletion algorithm of the Qserv Replication system doesn't remove all metadata from worker databases

      Igor Gaponenko Done
       
      DM-30103

      Support SQL binary data types in the Qserv Ingest system

      Igor Gaponenko Done
       
      DM-30704

      Improve the query status display in Qserv Web Dashboard

      Igor Gaponenko Done

        Activity

        There are no comments yet on this issue.

          People

          Assignee:
          Unassigned Unassigned
          Reporter:
          fritzm Fritz Mueller
          Watchers:
          Fritz Mueller
          Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

            Dates

            Created:
            Updated:

              Summary Panel

                CI Builds

                No builds found.