Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29841

Update faro application of external calibs

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: DM Subsystem Science
    • Labels:
      None

      Description

      Recent changes to how FGCM and jointcal calibrations are persisted break the way we apply external calibrations in `faro`. Update the relevant code in `faro` to enable external calibration.

      The specific error that happens when trying to run `faro` on the w_2021_14 processing of RC2 data is "Quantum graph is empty."

      From J. Bosch in #dm-science-pipelines on Apr. 20: "I bet some of your current input dataset types have changed form in the Gen3 versions of the tasks that produced them.  One big candidate is that FGCM and jointcal now write their outputs to per-visit catalogs (one row for each detector) with different dataset types, so if you'd been using those to calibrate your single-visit catalogs, and those were regular input connections, an empty QG is what you'd see."

        Attachments

          Issue Links

            Activity

            Hide
            kbechtol Keith Bechtol added a comment -
            Show
            kbechtol Keith Bechtol added a comment - See discussion thread here: https://lsstc.slack.com/archives/C4JQP6FRS/p1619541583262500
            Hide
            jcarlin Jeffrey Carlin added a comment -

            Note that this ticket only applies to implementing the new-style external calibrations for matched catalogs. We will update other types of `faro` metric calculations in separate tickets.

            Show
            jcarlin Jeffrey Carlin added a comment - Note that this ticket only applies to implementing the new-style external calibrations for matched catalogs. We will update other types of `faro` metric calculations in separate tickets.
            Hide
            kbechtol Keith Bechtol added a comment -

            See the discussion on the PR: https://github.com/lsst/faro/pull/84

            Show
            kbechtol Keith Bechtol added a comment - See the discussion on the PR: https://github.com/lsst/faro/pull/84

              People

              Assignee:
              jcarlin Jeffrey Carlin
              Reporter:
              jcarlin Jeffrey Carlin
              Reviewers:
              Keith Bechtol
              Watchers:
              Jeffrey Carlin, Keith Bechtol
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.