Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33161

Investigate metrics from verify_drp_metrics missing from dashboard after mid-November updates

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: faro
    • Labels:

      Description

      After we updated the rc2_subset nightly CI processing to inherit directly from obs_subaru's DRP.yaml pipeline, some metrics are no longer appearing on the verify_drp_metrics dashboard. Figure out why PA1_g, PA1_y, PF1_g, PF1_y, Star_PhotRep2, and Star_PhotRep3 are no longer showing measurements on the dashboard.

        Attachments

          Issue Links

          clones

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-32826 Investigate metric variations in verify_drp_metrics after mid-November updates

          • Done
          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-30243 Number of visits used by PA1 in faro

          • Done

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            jcarlin Jeffrey Carlin added a comment - - edited

            These metrics are missing because there are not enough objects satisfying the default criteria. By default, the photometric repeatability metrics require nMinPhotRepeat=50 stars between 200 < SNR < Inf, with >2 stars in the matched group. For g-band, there are only 39 stars satisfying these criteria (it increases to 60 stars for SNR > 100.) 

            The solution will be to (a) lower the SNR threshold for verify_drp_metrics, and (b) reduce the minimum number of objects required to report a result.

            Try snrMin = 100, nMinPhotRepeat = 20.

            For the star_photRep ones, the SNR thresholds are fixed. In those cases, we will simply need to configure nMinPhotRepeat.

            Show
            jcarlin Jeffrey Carlin added a comment - - edited These metrics are missing because there are not enough objects satisfying the default criteria. By default, the photometric repeatability metrics require nMinPhotRepeat=50 stars between 200 < SNR < Inf, with >2 stars in the matched group. For g-band, there are only 39 stars satisfying these criteria (it increases to 60 stars for SNR > 100.)  The solution will be to (a) lower the SNR threshold for verify_drp_metrics, and (b) reduce the minimum number of objects required to report a result. Try snrMin = 100, nMinPhotRepeat = 20. For the star_photRep ones, the SNR thresholds are fixed. In those cases, we will simply need to configure nMinPhotRepeat.
            Hide
            Permalink
            lguy Leanne Guy added a comment - - edited

            This is a good solution for CI, develpment and testing on precursor datasets. Obviously we'll have to think about appropriate values for on-sky data.

            Show
            lguy Leanne Guy added a comment - - edited This is a good solution for CI, develpment and testing on precursor datasets. Obviously we'll have to think about appropriate values for on-sky data.

              People

              Assignee:
              jcarlin Jeffrey Carlin
              Reporter:
              jcarlin Jeffrey Carlin
              Reviewers:
              Leanne Guy
              Watchers:
              Jeffrey Carlin, Leanne Guy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.