Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-33161

Investigate metrics from verify_drp_metrics missing from dashboard after mid-November updates

    XMLWordPrintable

Details

    • Story
    • Status: Done
    • Resolution: Done
    • None
    • faro

    Description

      After we updated the rc2_subset nightly CI processing to inherit directly from obs_subaru's DRP.yaml pipeline, some metrics are no longer appearing on the verify_drp_metrics dashboard. Figure out why PA1_g, PA1_y, PF1_g, PF1_y, Star_PhotRep2, and Star_PhotRep3 are no longer showing measurements on the dashboard.

      Attachments

        Issue Links

          Activity

            jcarlin Jeffrey Carlin added a comment - - edited

            These metrics are missing because there are not enough objects satisfying the default criteria. By default, the photometric repeatability metrics require nMinPhotRepeat=50 stars between 200 < SNR < Inf, with >2 stars in the matched group. For g-band, there are only 39 stars satisfying these criteria (it increases to 60 stars for SNR > 100.) 

            The solution will be to (a) lower the SNR threshold for verify_drp_metrics, and (b) reduce the minimum number of objects required to report a result.

            Try snrMin = 100, nMinPhotRepeat = 20.

            For the star_photRep ones, the SNR thresholds are fixed. In those cases, we will simply need to configure nMinPhotRepeat.

            jcarlin Jeffrey Carlin added a comment - - edited These metrics are missing because there are not enough objects satisfying the default criteria. By default, the photometric repeatability metrics require nMinPhotRepeat=50 stars between 200 < SNR < Inf, with >2 stars in the matched group. For g-band, there are only 39 stars satisfying these criteria (it increases to 60 stars for SNR > 100.)  The solution will be to (a) lower the SNR threshold for verify_drp_metrics, and (b) reduce the minimum number of objects required to report a result. Try snrMin = 100, nMinPhotRepeat = 20. For the star_photRep ones, the SNR thresholds are fixed. In those cases, we will simply need to configure nMinPhotRepeat.
            lguy Leanne Guy added a comment - - edited

            This is a good solution for CI, develpment and testing on precursor datasets. Obviously we'll have to think about appropriate values for on-sky data.

            lguy Leanne Guy added a comment - - edited This is a good solution for CI, develpment and testing on precursor datasets. Obviously we'll have to think about appropriate values for on-sky data.

            People

              jcarlin Jeffrey Carlin
              jcarlin Jeffrey Carlin
              Leanne Guy
              Jeffrey Carlin, Leanne Guy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Jenkins

                  No builds found.