Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34707

rc2_subset pipeline fails with missing dataset types

    XMLWordPrintable

Details

    • Bug
    • Status: Done
    • Resolution: Done
    • None
    • faro
    • None
    • DM Science
    • No

    Description

      As of 2022-05-04, and including w_2022_19, verify_drp_metrics failed due to missing dataset types finalized_ap_corr_catalog and finalized_src_table.

      WARNING 2022-05-04T18:17:54.992+00:00 lsst.pipe.base.graphBuilder ()(graphBuilder.py:758) - Dataset type finalized_psf_ap_corr_catalog is not registered.
      WARNING 2022-05-04T18:17:54.994+00:00 lsst.pipe.base.graphBuilder ()(graphBuilder.py:758) - Dataset type finalized_src_table is not registered.
      WARNING 2022-05-04T18:17:55.035+00:00 py.warnings ()(warnings.py:109) - /opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+5193352125/python/lsst/ctrl/mpexec/cli/script/qgraph.py:187: UserWarning: QuantumGraph is empty
      

      This appears to be related to https://github.com/lsst/pipe_tasks/pull/670#discussion_r859006641 and https://github.com/lsst/drp_pipe/commit/6bf0d64ac8d87cf47a97934d25bf34da9ecc1da2

      The appropriate fix might be to extend the pipeline, to remove downstream uses of these datasets, or to increase inheritance from the base pipeline so that future changes are automatically tracked.

      Attachments

        Activity

          erykoff Eli Rykoff added a comment -

          This branch worked when I ran bash bin/measureHscRC2Metrics.sh locally.

          erykoff Eli Rykoff added a comment - This branch worked when I ran bash bin/measureHscRC2Metrics.sh locally.
          ctslater Colin Slater added a comment -

          Looks good, thanks for taking care of this.

          ctslater Colin Slater added a comment - Looks good, thanks for taking care of this.

          People

            erykoff Eli Rykoff
            ktl Kian-Tat Lim
            Colin Slater
            Colin Slater, Eli Rykoff, Keith Bechtol, Kian-Tat Lim
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Jenkins

                No builds found.