Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25261

F20 Qserv Refactoring

    Details

    • Type: Epic
    • Status: In Progress
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      F20 Qserv Refactoring
    • Story Points:
      54
    • WBS:
      02C.06.02.03
    • Team:
      Data Access and Database
    • Cycle:
      Fall 2020

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
      DM-26575

      Worker crash in ~MySqlConfig

      4 John Gates To Do
      DM-24861

      Add GetEndpoint() to log messages relating to workers and xrootd.

      2 John Gates To Do
      DM-24308

      update qserv base image

      0 Nate Pease To Do
      DM-24541

      Limits have been placed on how many the transmits the worker can be sending the czar. This should be changed to a limit to transmits to individual czars.

      John Gates To Do
      DM-24540

      Incorrect scan rating being assigne to 'SELECT *' queries with no where clause.

      Unassigned To Do
      DM-24539

      czar virtual memory usage increases over time

      John Gates To Do
      DM-24538

      Some workers crash when several large result queries are being run.

      John Gates To Do
      DM-20456

      convert SqlConnection to use exceptions and test with sqlite

      16 Nate Pease To Do
      DM-20735

      Unordered collection of fully-qualified table names fed into Qserv metadata table QTable

      1 Nate Pease To Do
      DM-20301

      add LICENSE and COPYRIGHT files to Qserv

      1 Nate Pease To Do
      DM-19343

      Create an integration test for 'expected fail' queries

      10 Nate Pease To Do
      DM-17774

      Missing chunks in Qserv during joins between director tables

      6 John Gates To Do
      DM-17772

      Qserv joins between director tables using match tables

      6 Fritz Mueller To Do
      DM-17770

      Qserv does not parse alias within SELECT expressions

      8 Nate Pease To Do
      DM-18898

      add schema verification between the Czar and workers' Results

      6 Nate Pease To Do
      DM-17306

      in query classes, move _terms to protected or private.

      4 Nate Pease To Do
      DM-17293

      Improve error messages for WARN multiple errors to return errors

      Nate Pease To Do
      DM-20934

      the preflight query does not need anything but SELECT and FROM

      6 Nate Pease To Do
      DM-20923

      Trailing whitespace fetching async results with non-command line client fails to parse.

      Nate Pease To Do
      DM-20903

      investigate qserv slowdowns under mild load

      4 Nate Pease To Do
      DM-21439

      qserv integration tests fail if no database is already loaded

      2 Nate Pease To Do
      DM-15321

      Continue working on FIXME queries

      13 Nate Pease To Do
      DM-13709

      Use total worker stream buffer size to cancel very large queries.

      6 John Gates To Do
      DM-5984

      Use RO MySQL account in qserv_testdata

      4 Nate Pease To Do
      DM-2764

      Improve management of ColSchema.hasDefault and ColSchema.defaultValue

      10 Fabrice Jammes To Do
      DM-2717

      Add test involving many chunks

      5 Unassigned To Do
      DM-4883

      Refactor mysql and sql modules

      Unassigned To Do
      DM-5201

      sph-partition does not support BLOB fields

      15 Unassigned To Do
      DM-4949

      Improve MySQL proxy code and add unit tests

      4 Nate Pease To Do
      DM-1981

      Improve security for mysql in python

      5 Unassigned To Do
      DM-201

      Qserv: unit testing (controller module)

      10 Unassigned To Do
      DM-26859

      Test Qserv with multiple redirectors per master node

      4 Igor Gaponenko In Progress
      DM-26574

      Worker crash in wpublish::GetStatusCommand

      4 Igor Gaponenko In Progress
      DM-26207

      Investigate unusually large memory footprint in Qserv czar

      4 Igor Gaponenko In Progress
      DM-25794

      (some) mysqlproxy Lua fixes

      4 Fritz Mueller In Progress
      DM-27318

      Occasional crashes of Qserv workers due to running out of system resources

      3 Igor Gaponenko In Review
       
      DM-26579

      Remove unused code in MySqlConfig

      2 John Gates Done
       
      DM-26102

      Enable auto-tuning for the XRootD "spread" in Qserv

      2 Igor Gaponenko Done
       
      DM-26159

      Fix teardown crash in qhttp unit test

      0.5 Fritz Mueller Done
       
      DM-25891

      Extended configuration of the xrootd services in Qserv

      6 Igor Gaponenko Done
       
      DM-25868

      Fix a bug in a script starting XRootD services at Qserv deployments

      1 Igor Gaponenko Done
       
      DM-25987

      Fix a typo in the Replication schema definition

      0.2 Igor Gaponenko Done
       
      DM-25980

      Increased connection timeout for the backend service in a configuration of mysql-proxy

      2 Igor Gaponenko Done
       
      DM-26609

      Fix resource registration/publishing order in Qserv workers for added/removed chunks

      3 Igor Gaponenko Done
       
      DM-25232

      Minor refactoring in Qserv due to migration to Protobuf version 3 API

      0.5 Igor Gaponenko Done
       
      DM-27184

      Fixed bugs in using the JSON-based configuration store by applications in package partition

      1 Igor Gaponenko Done
       
      DM-26264

      Fix qhttp ajax unit test

      0.5 Fritz Mueller Done
      DM-26754

      Migrating a configuration system of the Qserv partitioning tools to JSON

      7 Igor Gaponenko Reviewed

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            fritzm Fritz Mueller
            Watchers:
            Fritz Mueller
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Summary Panel