Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-8140

Deblender work in S17

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: meas_deblender
    • Labels:
      None
    • Epic Name:
      s17-drp-deblender
    • Story Points:
      140
    • WBS:
      02C.04.05
    • Team:
      Data Release Production
    • Cycle:
      Spring 2017

      Description

      This epic aims to investigate a number of techniques for deblending which address both current high-priority issues and longer term requirements. The primary aim is to explore the problem space rather than deliver production-ready code. Ultimately, it should result in a coherent development plan for future work.

        Attachments

          Issue Links

          Stories in Epic (Custom Issue Matrix)

          Key Summary Story Points Assignee Status
           
          DM-8640

          Update deblender docstring

          1 Fred Moolekamp Done
           
          DM-8624

          Evaluate the deblender using simulations

          8 Bob Armstrong Done
           
          DM-8831

          Investigate using NMF for deblender

          6 Fred Moolekamp Done
           
          DM-8959

          Create NMF deblender plugin

          16 Fred Moolekamp Done
           
          DM-8694

          Refactor Deblender API

          3 Fred Moolekamp Done
           
          DM-8059

          Failure to identify red-sequence galaxies in the cores of clusters

          8 Bob Armstrong Done
           
          DM-10612

          Implement strict monotonicity

          3 Fred Moolekamp Done
           
          DM-9965

          Fix bug in monotonicity operator

          1 Fred Moolekamp Done
           
          DM-9954

          Optimize PSF convolution to use sparse matrices

          2 Fred Moolekamp Done
           
          DM-10090

          Faster (and correct) conversion for NMF deblender

          4 Fred Moolekamp Done
           
          DM-9997

          Investigate using both monotonicity and symmetry

          4 Fred Moolekamp Done
           
          DM-10138

          Compare the convergence of ADMM, SDMM, and GLM algorithms

          3 Fred Moolekamp Done
           
          DM-9173

          Study deblending techniques

          4 Fred Moolekamp Done
           
          DM-9172

          Implement validation metrics for NMF outputs

          6 Fred Moolekamp Done
           
          DM-9171

          Implement NMF with alternating least squares

          4 Fred Moolekamp Done
           
          DM-9170

          Implement PSF convolution operator in 2D

          6 Fred Moolekamp Done
           
          DM-9169

          Provide high-stellar-density fields for deblender testing

          4 Bob Armstrong Done
           
          DM-9168

          Provide HSC test data for deblending

          8 Bob Armstrong Done
           
          DM-9143

          Create 2D monotonic operator for NMF deblender

          4 Fred Moolekamp Done
           
          DM-10189

          Create translation operator

          9 Fred Moolekamp Done
           
          DM-10502

          Update NMF deblender to use new footprints

          1 Fred Moolekamp Done
           
          DM-10483

          Create testdata_deblender Repo

          1 Fred Moolekamp Done
           
          DM-10332

          Test deblender with exact positions

          5 Fred Moolekamp Done
           
          DM-10151

          Investigate a better symmetry operator

          3 Fred Moolekamp Done
           
          DM-9681

          Write function to apportion flux based on NMF template weights

          1 Fred Moolekamp Done
           
          DM-9675

          Soften symmetry operator requirements

          1 Fred Moolekamp Done
           
          DM-9645

          Come up to speed with new deblending algorithm.

          3 Bob Armstrong Done
           
          DM-9644

          Write out true galaxy images in blending simulation script

          2 Bob Armstrong Done
           
          DM-9640

          Add stars to blending simulation script

          4 Bob Armstrong Done
           
          DM-9561

          Improve Monotonicity Operator

          8 Fred Moolekamp Done
           
          DM-9784

          Implement test for overlapping galaxies

          5 Fred Moolekamp Done
           
          DM-9775

          Create NMF deblender presentation

          3 Fred Moolekamp Done
           
          DM-8677

          Remove unused parameter in deblender

          0 Fred Moolekamp Invalid
           
          DM-8623

          Build galaxy templates from existing models

          8 Unassigned Invalid
           
          DM-8622

          Add hierarchical ordering to deblender

          8 Unassigned Invalid
           
          DM-7505

          Design refactored deblender

          6 Bob Armstrong Invalid
           
          DM-9956

          Add test for difference of overlap between objects

          3 Fred Moolekamp Invalid

            Activity

            swinbank John Swinbank created issue -
            swinbank John Swinbank made changes -
            Field Original Value New Value
            Epic Child DM-8139 [ 27594 ]
            swinbank John Swinbank made changes -
            Summary Deblender work in F17 Deblender work in S17
            swinbank John Swinbank made changes -
            Epic Name f17-drp-deblender s17-drp-deblender
            swinbank John Swinbank made changes -
            Epic Child DM-7505 [ 26635 ]
            swinbank John Swinbank made changes -
            Epic Child DM-4743 [ 22043 ]
            rearmstr Bob Armstrong made changes -
            Epic Child DM-8266 [ 27785 ]
            swinbank John Swinbank made changes -
            Description Aims of epic:

            - Begin work on multiband/multithreaded deblender;
            - Resolve known failure modes in existing deblender.

            Need to define concrete deliverable before cycle starts.
            Aims of epic:

            - Begin work on multiband/multithreaded deblender;
            - Resolve known failure modes in existing deblender.
            swinbank John Swinbank made changes -
            Epic Child DM-8139 [ 27594 ]
            swinbank John Swinbank made changes -
            Epic Child DM-8059 [ 27499 ]
            swinbank John Swinbank made changes -
            Link This issue blocks DM-926 [ DM-926 ]
            swinbank John Swinbank made changes -
            Story Points 150
            swinbank John Swinbank made changes -
            Story Points 150 140
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8620 [ 28285 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8621 [ 28286 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8622 [ 28287 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8623 [ 28288 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8624 [ 28289 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8640 [ 28308 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8677 [ 28441 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8694 [ 28469 ]
            swinbank John Swinbank made changes -
            Epic Child DM-8139 [ 27594 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8831 [ 29047 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-8959 [ 29235 ]
            swinbank John Swinbank made changes -
            Status To Do [ 10001 ] In Progress [ 3 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9143 [ 29696 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9168 [ 29738 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9169 [ 29739 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9170 [ 29740 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9171 [ 29741 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9172 [ 29742 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9173 [ 29743 ]
            swinbank John Swinbank made changes -
            Description Aims of epic:

            - Begin work on multiband/multithreaded deblender;
            - Resolve known failure modes in existing deblender.
            This epic aims to investigate a number of techniques for deblending which address both current high-priority issues and longer term requirements. The primary aim is to explore the problem space rather than deliver production-ready code. Ultimately, it should result in a coherent development plan for future work.
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9561 [ 30512 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9584 [ 30566 ]
            rearmstr Bob Armstrong made changes -
            Epic Child DM-9640 [ 30689 ]
            rearmstr Bob Armstrong made changes -
            Epic Child DM-9644 [ 30693 ]
            rearmstr Bob Armstrong made changes -
            Epic Child DM-9645 [ 30694 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9675 [ 30777 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9681 [ 30786 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9775 [ 31121 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9784 [ 31133 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9954 [ 31385 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9956 [ 31387 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9957 [ 31388 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9965 [ 31400 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9997 [ 31509 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10090 [ 31663 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10138 [ 31751 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10151 [ 31774 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10189 [ 31826 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10190 [ 31827 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10310 [ 32002 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10332 [ 32028 ]
            swinbank John Swinbank made changes -
            Epic Child DM-4743 [ 22043 ]
            swinbank John Swinbank made changes -
            Epic Child DM-8139 [ 27594 ]
            swinbank John Swinbank made changes -
            Epic Child DM-8266 [ 27785 ]
            swinbank John Swinbank made changes -
            Epic Child DM-8620 [ 28285 ]
            swinbank John Swinbank made changes -
            Epic Child DM-8621 [ 28286 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9784 [ 31133 ]
            swinbank John Swinbank made changes -
            Epic Child DM-10190 [ 31827 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10483 [ 32258 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10502 [ 32282 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9784 [ 31133 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10310 [ 32002 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-9584 [ 30566 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-10612 [ 32556 ]
            swinbank John Swinbank made changes -
            Epic Child DM-9957 [ 31388 ]
            swinbank John Swinbank made changes -
            Resolution Done [ 10000 ]
            Status In Progress [ 3 ] Done [ 10002 ]
            fred3m Fred Moolekamp made changes -
            Epic Child DM-11554 [ 33866 ]
            swinbank John Swinbank made changes -
            Epic Child DM-11554 [ 33866 ]

              People

              • Assignee:
                swinbank John Swinbank
                Reporter:
                swinbank John Swinbank
                Watchers:
                John Swinbank
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel