Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29447

Disallow using TEXT/BLOB types in the director tables during catalog ingest

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: Qserv
    • Labels:
      None

      Description

      Goals

      This effort was triggered by DM-27273.
      The current implementation of the Replication/Ingest system doesn't prevent ingest workflows to use the variable-length types TEXT/BLOB in the column specifications of the "director" tables. This causes problems in processing certain classes of queries where sub-chunks get materialized using MySQL's MEMORY engine. The problems are reported by Qserv as shown below:

      ERROR 4120 (Proxy) at line 1: Unable to return query results:
      [1470] Error(s) in result for chunk #1234567890: [1163] Storage engine MEMORY doesn't support BLOB/TEXT columns Error retrieving results for 
      

      Reinforce the implementation of the system to disallow using the above-mentioned types. Errors should be reported back to the workflows using the existing error-reporting mechanism.

        Attachments

          Issue Links

            Activity

            There are no comments yet on this issue.

              People

              Assignee:
              gapon Igor Gaponenko
              Reporter:
              gapon Igor Gaponenko
              Watchers:
              Fritz Mueller, Igor Gaponenko, Nate Pease
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated: