Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27270

ap_verify failed on w_2020_43

    XMLWordPrintable

Details

    • Bug
    • Status: Done
    • Resolution: Done
    • None
    • ap_verify
    • None
    • 1
    • DRP F20-5 (Oct)
    • Data Release Production
    • No

    Description

      A dataset type was not found, causing AssertionError: Query used to initialize dataset results must have a dataset. in the Gen3 execution of ap_verify.

      The error occurs after "ap.verify.ingestion.ingestDataset INFO: Data ingested" and "ap.verify.ap_verify.main INFO: Running pipeline..." log messages.

      The full log is available at https://ci.lsst.codes/job/scipipe/job/ap_verify/742/artifact/cosmos_pdr2-master%5Egen3%5Eap_verify-installed/run/CI-CosmosPDR2/apVerify.log.xz

      The traceback is:

      Traceback (most recent call last):
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/daf
      _butler/19.0.0-179-g77e9868a+ff10c6d78d/python/lsst/daf/butler/cli/utils.py", li
      ne 446, in cli_handle_exception
          return func(*args, **kwargs)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/ctr
      l_mpexec/20.0.0-32-gda3fe65+21c692af9c/python/lsst/ctrl/mpexec/cli/script/qgraph
      .py", line 133, in qgraph
          qgraph = f.makeGraph(pipelineObj, args)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/ctr
      l_mpexec/20.0.0-32-gda3fe65+21c692af9c/python/lsst/ctrl/mpexec/cmdLineFwk.py", l
      ine 571, in makeGraph
          qgraph = graphBuilder.makeGraph(pipeline, collections, run, args.data_query)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/pip
      e_base/20.0.0-23-g8900aa8+dfd6ff4ddf/python/lsst/pipe/base/graphBuilder.py", lin
      e 929, in makeGraph
          skipExisting=self.skipExisting)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/pipe_base/20.0.0-23-g8900aa8+dfd6ff4ddf/python/lsst/pipe/base/graphBuilder.py", line 641, in resolveDatasetRefs
          findFirst=True
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/daf_butler/19.0.0-179-g77e9868a+ff10c6d78d/python/lsst/daf/butler/registry/queries/_results.py", line 310, in findDatasets
          records=self._records)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/daf_butler/19.0.0-179-g77e9868a+ff10c6d78d/python/lsst/daf/butler/registry/queries/_results.py", line 398, in __init__
          "Query used to initialize dataset results must have a dataset."
      

      Attachments

        Activity

          People

            nlust Nate Lust
            ktl Kian-Tat Lim
            Kian-Tat Lim
            Kian-Tat Lim, Nate Lust
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Jenkins

                No builds found.