Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34707

rc2_subset pipeline fails with missing dataset types

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: faro
    • Labels:
      None
    • Team:
      DM Science
    • Urgent?:
      No

      Description

      As of 2022-05-04, and including w_2022_19, verify_drp_metrics failed due to missing dataset types finalized_ap_corr_catalog and finalized_src_table.

      WARNING 2022-05-04T18:17:54.992+00:00 lsst.pipe.base.graphBuilder ()(graphBuilder.py:758) - Dataset type finalized_psf_ap_corr_catalog is not registered.
      WARNING 2022-05-04T18:17:54.994+00:00 lsst.pipe.base.graphBuilder ()(graphBuilder.py:758) - Dataset type finalized_src_table is not registered.
      WARNING 2022-05-04T18:17:55.035+00:00 py.warnings ()(warnings.py:109) - /opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+5193352125/python/lsst/ctrl/mpexec/cli/script/qgraph.py:187: UserWarning: QuantumGraph is empty
      

      This appears to be related to https://github.com/lsst/pipe_tasks/pull/670#discussion_r859006641 and https://github.com/lsst/drp_pipe/commit/6bf0d64ac8d87cf47a97934d25bf34da9ecc1da2

      The appropriate fix might be to extend the pipeline, to remove downstream uses of these datasets, or to increase inheritance from the base pipeline so that future changes are automatically tracked.

        Attachments

          Activity

          Hide
          erykoff Eli Rykoff added a comment -

          This branch worked when I ran bash bin/measureHscRC2Metrics.sh locally.

          Show
          erykoff Eli Rykoff added a comment - This branch worked when I ran bash bin/measureHscRC2Metrics.sh locally.
          Hide
          ctslater Colin Slater added a comment -

          Looks good, thanks for taking care of this.

          Show
          ctslater Colin Slater added a comment - Looks good, thanks for taking care of this.

            People

            Assignee:
            erykoff Eli Rykoff
            Reporter:
            ktl Kian-Tat Lim
            Reviewers:
            Colin Slater
            Watchers:
            Colin Slater, Eli Rykoff, Keith Bechtol, Kian-Tat Lim
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.