Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-27270

ap_verify failed on w_2020_43

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: ap_verify
    • Labels:
      None
    • Story Points:
      1
    • Epic Link:
    • Sprint:
      DRP F20-5 (Oct)
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      A dataset type was not found, causing AssertionError: Query used to initialize dataset results must have a dataset. in the Gen3 execution of ap_verify.

      The error occurs after "ap.verify.ingestion.ingestDataset INFO: Data ingested" and "ap.verify.ap_verify.main INFO: Running pipeline..." log messages.

      The full log is available at https://ci.lsst.codes/job/scipipe/job/ap_verify/742/artifact/cosmos_pdr2-master%5Egen3%5Eap_verify-installed/run/CI-CosmosPDR2/apVerify.log.xz

      The traceback is:

      Traceback (most recent call last):
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/daf
      _butler/19.0.0-179-g77e9868a+ff10c6d78d/python/lsst/daf/butler/cli/utils.py", li
      ne 446, in cli_handle_exception
          return func(*args, **kwargs)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/ctr
      l_mpexec/20.0.0-32-gda3fe65+21c692af9c/python/lsst/ctrl/mpexec/cli/script/qgraph
      .py", line 133, in qgraph
          qgraph = f.makeGraph(pipelineObj, args)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/ctr
      l_mpexec/20.0.0-32-gda3fe65+21c692af9c/python/lsst/ctrl/mpexec/cmdLineFwk.py", l
      ine 571, in makeGraph
          qgraph = graphBuilder.makeGraph(pipeline, collections, run, args.data_query)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/pip
      e_base/20.0.0-23-g8900aa8+dfd6ff4ddf/python/lsst/pipe/base/graphBuilder.py", lin
      e 929, in makeGraph
          skipExisting=self.skipExisting)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/pipe_base/20.0.0-23-g8900aa8+dfd6ff4ddf/python/lsst/pipe/base/graphBuilder.py", line 641, in resolveDatasetRefs
          findFirst=True
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/daf_butler/19.0.0-179-g77e9868a+ff10c6d78d/python/lsst/daf/butler/registry/queries/_results.py", line 310, in findDatasets
          records=self._records)
        File "/opt/lsst/software/stack/stack/miniconda3-py37_4.8.2-cb4e2dc/Linux64/daf_butler/19.0.0-179-g77e9868a+ff10c6d78d/python/lsst/daf/butler/registry/queries/_results.py", line 398, in __init__
          "Query used to initialize dataset results must have a dataset."
      

        Attachments

          Activity

          Hide
          ktl Kian-Tat Lim added a comment -

          Looks good and runs in Jenkins.

          Show
          ktl Kian-Tat Lim added a comment - Looks good and runs in Jenkins.

            People

            Assignee:
            nlust Nate Lust
            Reporter:
            ktl Kian-Tat Lim
            Reviewers:
            Kian-Tat Lim
            Watchers:
            Kian-Tat Lim, Nate Lust
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.