Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-25863

Fix and update metric generation in colorAnalysis.py

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_analysis
    • Labels:
      None
    • Story Points:
      2
    • Epic Link:
    • Sprint:
      DRP F20-1 (June), DRP F20-2 (July)
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      As of DM-22255, it appears the metrics defined in colorAnalysis.py are no longer being added to the verify job, so the persisted json file does not included any actual measurements (e.g. they do exist in datasets/hsc/repo/rerun/RC/w_2020_19/DM-24822/verify/color/tract-9813/colorAnalysis_verify_job.json, but are not present in datasets/hsc/repo/rerun/RC/w_2020_22/DM-25176/verify/color/tract-9813/colorAnalysis_verify_job.json). This needs to be fixed.

      Additionally, to allow tracking the metrics per-tract when dispatched to the SQuaSH metrics dashboard, a tract tag needs to be added to the metric metadata.

        Attachments

          Issue Links

          relates to

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-21320 Add first metric to colorAnalysis

          • Done

          Story - Created by Jira Software - do not edit or delete. Issue type for a user story. DM-22255 Move plotting IO out of plotting functions in coaddAnalysis

          • Done
          mentioned in

          Page Loading...

            Activity

            Hide
            Permalink
            lauren Lauren MacArthur added a comment - - edited

            I hate to burden you with another review, but would you mind giving this a look to make sure all is working as desired? I ran colorAnalysis.py on all three tracts (twice for 9813 with a different set of patches to get different metric values and three identical runs on 9615 and just once for 9697) and dispatched the results to SQuaSH. After a few tweaks to the "pipe_analysis" dashboard, they are indeed coming up as a filter (see attached plots).
            Pull request

            Show
            lauren Lauren MacArthur added a comment - - edited I hate to burden you with another review, but would you mind giving this a look to make sure all is working as desired? I ran colorAnalysis.py on all three tracts (twice for 9813 with a different set of patches to get different metric values and three identical runs on 9615 and just once for 9697) and dispatched the results to SQuaSH. After a few tweaks to the "pipe_analysis" dashboard, they are indeed coming up as a filter (see attached plots). Pull request

              People

              Assignee:
              lauren Lauren MacArthur
              Reporter:
              lauren Lauren MacArthur
              Reviewers:
              Yusra AlSayyad
              Watchers:
              Lauren MacArthur, Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Jenkins

                  No builds found.