Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27915

Migrate Qserv integration tests to the JSON-based configuration of the partitioning tools

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: Qserv
    • Labels:
      None

      Description

      The current version of the integration tools fails and reports the following:

      2020-12-08 03:56:46,762 - lsst.qserv.tests.qservDbLoader - INFO - Partition data, create and load table Source
      option '--in' is ambiguous and matches '--in.csv.delimiter', '--in.csv.escape', '--in.csv.field', '--in.csv.no-escape', '--in.csv.no-quote', '--in.csv.null', '--in.csv.quote', and '--in.path'
      2020-12-08 03:56:47,158 - lsst.qserv.admin.dataLoader - ERROR - Failed to run partitioner: CalledProcessError(1, ['sph-partition', '--out.dir', '/qserv/run/tmp/qserv_data_loader/Source', '--part.prefix', 'chunk', '--config-file', '/qserv/stack/stack/miniconda3-py37_4.8.2-ceb6bb6/Linux64/qserv_testdata/2016_08-33-g9183a47+28595b5b35/datasets/case01/data/common.cfg', '--config-file', '/qserv/stack/stack/miniconda3-py37_4.8.2-ceb6bb6/Linux64/qserv_testdata/2016_08-33-g9183a47+28595b5b35/datasets/case01/data/Source.cfg', '--in', '/qserv/run/tmp/qserv_data_loader/Source/tmp6jvebctt/Source.tsv'])
      

      This was triggered by migrating the package to depend on the latest version of package partition. The later requires configuration files to be in the JSON format (see DM-26754).

        Attachments

          Issue Links

            Activity

            There are no comments yet on this issue.

              People

              Assignee:
              gapon Igor Gaponenko
              Reporter:
              gapon Igor Gaponenko
              Reviewers:
              Fritz Mueller
              Watchers:
              Fritz Mueller, Igor Gaponenko, Nate Pease
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: