Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34414

Add metrics for deblending

    XMLWordPrintable

    Details

    • Story Points:
      3
    • Sprint:
      DRP S22B, DRP S23A
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      Now that we've implemented procedures to skip blends based on size, saturation, number of children, etc., we should have metrics to keep track of the number of blends skipped for each cut to know how many blends and how many peaks are being cut.

      The current metrics I'm thinking of are:

      • total number of blends
      • total number of detected peaks
      • number of blends skipped because they were too large
      • number of blends skipped because they had too many peaks
      • number of blends skipped because they contained masked pixels
      • number of peaks skipped because they contained masked pixels
      • number of blends that failed

      Feel free to add any other metrics that might be useful to calculate.

        Attachments

          Activity

          Hide
          krzys Krzysztof Findeisen added a comment -

          Just found this issue. Do any of the metrics from DM-27032 (https://github.com/lsst/pipe_tasks/blob/main/python/lsst/pipe/tasks/metrics.py) help you? It would be nice to avoid duplicating work, where possible.

          (For that matter, Eric Bellm, do we want to use any of the metrics from Fred Moolekamp's list in ap_verify?)

          Show
          krzys Krzysztof Findeisen added a comment - Just found this issue. Do any of the metrics from DM-27032 ( https://github.com/lsst/pipe_tasks/blob/main/python/lsst/pipe/tasks/metrics.py ) help you? It would be nice to avoid duplicating work, where possible. (For that matter, Eric Bellm , do we want to use any of the metrics from Fred Moolekamp 's list in ap_verify ?)
          Hide
          fred3m Fred Moolekamp added a comment -

          Agreed about duplicate code/work. In this case I'm hoping to avoid this by creating a generic task to run measurements on a column (count the number of sources, calculate the mean, sum, etc) and create a selector to only choose parents. If that doesn't work out then I'll probably use the metric that you pointed to.

          Note that blends never fail with the single-band deblender, so that column doesn't exist in the meas_deblender output catalog. The rest should work for both deblenders if you decide to implement them.

          Show
          fred3m Fred Moolekamp added a comment - Agreed about duplicate code/work. In this case I'm hoping to avoid this by creating a generic task to run measurements on a column (count the number of sources, calculate the mean, sum, etc) and create a selector to only choose parents. If that doesn't work out then I'll probably use the metric that you pointed to. Note that blends never fail with the single-band deblender, so that column doesn't exist in the meas_deblender output catalog. The rest should work for both deblenders if you decide to implement them.

            People

            Assignee:
            fred3m Fred Moolekamp
            Reporter:
            fred3m Fred Moolekamp
            Watchers:
            Fred Moolekamp, Krzysztof Findeisen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:

                Jenkins

                No builds found.