Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-32376

ap_verify gen3 fails to find jointcal_photoCalib dataset in graph generation

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_tasks
    • Labels:
      None
    • Story Points:
      1
    • Epic Link:
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      ap_verify gen3 failed last night with the following error:

      RuntimeError: 2 dataset(s) of type 'jointcal_photoCalib' was/were present in a previous query, but could not be found now.This is either a logic bug in QuantumGraph generation or the input collections have been modified since QuantumGraph generation began.

      It seems likely that this was caused by DM-31491, which just landed and at a minimum reordered the dimensions for this dataset. https://github.com/lsst/pipe_tasks/commit/e5427992456a875016af14c907ea1f8bd786fb6f#diff-d0c181586a7ef6ce433ff7baee9b2fa03ab7de10015e6cafa57741a90a424d2dL77-R94

      I believe that there is also a typo later in the same PR: https://github.com/lsst/pipe_tasks/commit/e5427992456a875016af14c907ea1f8bd786fb6f#diff-d0c181586a7ef6ce433ff7baee9b2fa03ab7de10015e6cafa57741a90a424d2dR369

      Fixing this before the weekly would be highly desirable.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-31769 Add user control over dataset constraints in QG generation queries

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-32058 Duplicate faro task in pipeline gives cryptic error

          • Done

            Activity

            Ascending order - Click to sort in descending order
            ktl Kian-Tat Lim created issue -
            jbosch Jim Bosch made changes -
            Field Original Value New Value
            Link This issue relates to DM-31769 [ DM-31769 ]
            jbosch Jim Bosch made changes -
            Link This issue relates to DM-32058 [ DM-32058 ]
            sophiereed Sophie Reed made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            sophiereed Sophie Reed made changes -
            Reviewers Lee Kelvin [ lskelvin ]
            Status In Progress [ 3 ] In Review [ 10004 ]
            lskelvin Lee Kelvin made changes -
            Status In Review [ 10004 ] Reviewed [ 10101 ]
            sophiereed Sophie Reed made changes -
            Resolution Done [ 10000 ]
            Status Reviewed [ 10101 ] Done [ 10002 ]
            yusra Yusra AlSayyad made changes -
            Epic Link DM-30540 [ 511198 ]
            Story Points 1
            tjenness Tim Jenness made changes -
            Labels backport-v23
            tjenness Tim Jenness made changes -
            Labels backport-v23

              People

              Assignee:
              sophiereed Sophie Reed
              Reporter:
              ktl Kian-Tat Lim
              Reviewers:
              Lee Kelvin
              Watchers:
              Eli Rykoff, Jim Bosch, Kian-Tat Lim, Lee Kelvin, Nate Lust, Sophie Reed, Tim Jenness, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.