Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-10283

Add ability to join different databases.

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Sprint:
      DB_S17_5
    • Team:
      Data Access and Database

      Description

      Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

      An example of this would be an attempt to figure out all entries from the ForcedSource table of WISE catalog (database wise_00) which correspond to the rejected objects of the catalog (those objects live in a separate database wise_ext_00):

      SELECT COUNT(ForcedSource.source_id_mf)
      		 
        FROM
      		 
          wise_ext_00.Reject Reject,
      		 
          wise_00.ForcedSource ForcedSource
      		 
        WHERE
      		 
          Reject.source_id LIKE '0000m016_ac51-000002'
      		 
        AND ForcedSource.source_id_mf = Reject.source_id;
      		 
      ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
      		 
      partitioned table joins that Qserv does not know how to evaluate using only partition-local data

      The only relevant line in the CZAR's log file is:

      [2017-04-21T16:01:43.412-0500] [LWP:346] ERROR ccontrol.UserQueryFactory (core/modules/ccontrol/UserQueryFactory.cc:114)
      		 
      - Invalid query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate
      		 
      using only partition-local data

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-9372 Load WISE catalog data in PDAC

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-12910 Summary of WISE catalogs loaded into PDAC in 2017

          • Done

            Activity

            Ascending order - Click to sort in descending order
            jgates John Gates created issue -
            jgates John Gates made changes -
            Field Original Value New Value
            Rank Ranked higher
            jgates John Gates made changes -
            Priority Undefined [ 10000 ] Major [ 3 ]
            jgates John Gates made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time. Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf) FROM wise_ext_00.Reject Reject, wise_00.ForcedSource ForcedSource WHERE Reject.source_id LIKE '0000m016_ac51-000002' AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {sql}
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf) FROM wise_ext_00.Reject Reject, wise_00.ForcedSource ForcedSource WHERE Reject.source_id LIKE '0000m016_ac51-000002' AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {sql}             		Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM wise_ext_00.Reject Reject, wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM wise_ext_00.Reject Reject, wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}             		Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM wise_ext_00.Reject Reject, wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM wise_ext_00.Reject Reject, wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}             		Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}             		Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}

            The only relevant line in the *CZAR*'s log file is:
            {code}
            [2017-04-21T16:01:43.412-0500] [LWP:346] ERROR ccontrol.UserQueryFactory (core/modules/ccontrol/UserQueryFactory.cc:114) - Invalid query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}

            The only relevant line in the *CZAR*'s log file is:
            {code}
            [2017-04-21T16:01:43.412-0500] [LWP:346] ERROR ccontrol.UserQueryFactory (core/modules/ccontrol/UserQueryFactory.cc:114) - Invalid query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}             		Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}

            The only relevant line in the *CZAR*'s log file is:
            {code}
            [2017-04-21T16:01:43.412-0500] [LWP:346] ERROR ccontrol.UserQueryFactory (core/modules/ccontrol/UserQueryFactory.cc:114)
             - Invalid query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}
            gapon Igor Gaponenko made changes -
            Description Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}

            The only relevant line in the *CZAR*'s log file is:
            {code}
            [2017-04-21T16:01:43.412-0500] [LWP:346] ERROR ccontrol.UserQueryFactory (core/modules/ccontrol/UserQueryFactory.cc:114)
             - Invalid query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}             		Joins between two databases are not working. On the PDAC, stripe82 cannot be joined with WISE, despite using identical partitioning methods. This is probably a result of an expectation that qserv would onlt access one database at time.

            An example of this would be an attempt to figure out all entries from the *ForcedSource* table of *WISE* catalog (database *wise_00*) which correspond to the _rejected_ objects of the catalog (those objects live in a separate database *wise_ext_00*):
            {code:sql}
            SELECT COUNT(ForcedSource.source_id_mf)
              FROM
                wise_ext_00.Reject Reject,
                wise_00.ForcedSource ForcedSource
              WHERE
                Reject.source_id LIKE '0000m016_ac51-000002'
              AND ForcedSource.source_id_mf = Reject.source_id;
            ERROR 4110 (Proxy): Query processing error: QI=?: Failed to instantiate query: AnalysisError:Query involves
            partitioned table joins that Qserv does not know how to evaluate using only partition-local data
            {code}

            The only relevant line in the *CZAR*'s log file is:
            {code}
            [2017-04-21T16:01:43.412-0500] [LWP:346] ERROR ccontrol.UserQueryFactory (core/modules/ccontrol/UserQueryFactory.cc:114)
            - Invalid query: AnalysisError:Query involves partitioned table joins that Qserv does not know how to evaluate
            using only partition-local data
            {code}
            fritzm Fritz Mueller made changes -
            Sprint DB_S17_5 [ 615 ]
            jgates John Gates made changes -
            Reviewers Andy Salnikov, Igor Gaponenko [ salnikov, gapon ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            jgates John Gates made changes -
            Resolution Done [ 10000 ]
            Status In Review [ 10004 ] Done [ 10002 ]
            gapon Igor Gaponenko made changes -
            Link This issue relates to DM-9372 [ DM-9372 ]
            gapon Igor Gaponenko made changes -
            Link This issue relates to DM-12910 [ DM-12910 ]

              People

              Assignee:
              jgates John Gates
              Reporter:
              jgates John Gates
              Reviewers:
              Andy Salnikov, Igor Gaponenko
              Watchers:
              Andy Salnikov, Igor Gaponenko, John Gates, Serge Monkewitz
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.