Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-16676

Commission New Deblender "Scarlet" during S19

    Details

    • Type: Epic
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Epic Name:
      s19-drp-deblender
    • Story Points:
      135
    • WBS:
      02C.04.05
    • Team:
      Data Release Production
    • Cycle:
      Spring 2019

      Attachments

      Stories in Epic (Custom Issue Matrix)

      Key Summary Story Points Assignee Status
       
      DM-19650

      Ensure scarlet failures are propagated to the stack

      2 Fred Moolekamp Done
       
      DM-19649

      Fix doc line lengths in meas_extensions_scarlet

      1 Nate Lust Done
       
      DM-19648

      Add lsst init functionality to meas_extensions_scarlet

      1 Nate Lust Done
       
      DM-18744

      Create presentation for DESC BTF

      2 Fred Moolekamp Done
       
      DM-18171

      Create Regression Tests for scarlet

      14 Fred Moolekamp Done
       
      DM-17605

      Implement S matrix normalization in scarlet

      1 Fred Moolekamp Done
       
      DM-17670

      Update scarlet notebooks and docs

      2 Fred Moolekamp Done
       
      DM-17748

      Use autograd for derivatives in scarlet

      45 Fred Moolekamp Done
       
      DM-17960

      Test FFT PSF convolution algorithms

      12 Fred Moolekamp Done
       
      DM-18021

      Use FFT convolutions in scarlet

      11 Fred Moolekamp Done
       
      DM-17847

      Update defaults in scarlet and create changelog

      1 Fred Moolekamp Done
       
      DM-17846

      Understand PSF issues in deblending

      7 Fred Moolekamp Done
       
      DM-19823

      Improvements to scarlet to support deblender integration sprint.

      2 Fred Moolekamp Done
       
      DM-19819

      Run Multiband with New Scarlet Du Jour during Deblender Sprint

      3 Yusra AlSayyad Done
       
      DM-19814

      Prototype Speedy Symmetry Solution

      2 Nate Lust Done
       
      DM-19795

      Visualize Scarlet models with HST Candels

      6 Dan Taranu Done
       
      DM-19783

      Fix units in meas_extensions_scarlet

      1 Nate Lust Done
       
      DM-19782

      Fix failures identified in DM-19759

      4 Fred Moolekamp Done
       
      DM-19673

      Switch scarlet from pytorch to autograd

      4 Fred Moolekamp Done
       
      DM-19733

      Make scarlet models more general

      8 Fred Moolekamp Done
       
      DM-19720

      Change multiband.py to support meas_extensions_scarlet

      5 Nate Lust Done

        Activity

        Hide
        yusra Yusra AlSayyad added a comment -

        This epic culminated by integrating New Scarlet into the stack. It runs as a task between mergeCoaddDetections and MeasureCoaddSources. It was modified to depend on the lighterweight autograd instead of PyTorch. It was run on a tract composed of mini 700x700 pixel patches, and some preliminary profiling, and QA metrics computed. We estimate that multibandDriver run on a regular patch run with the new deblender with takes roughly 50 hours rather than the normal average of 25.

        The Sprint Demo materials presented can be found at:

        Show
        yusra Yusra AlSayyad added a comment - This epic culminated by integrating New Scarlet into the stack. It runs as a task between mergeCoaddDetections and MeasureCoaddSources. It was modified to depend on the lighterweight autograd instead of PyTorch. It was run on a tract composed of mini 700x700 pixel patches, and some preliminary profiling, and QA metrics computed. We estimate that multibandDriver run on a regular patch run with the new deblender with takes roughly 50 hours rather than the normal average of 25. The Sprint Demo materials presented can be found at: https://paper.dropbox.com/doc/Deblender-Sprint-Demo-xLbVRQZhCtPs4gNpyIBZI https://github.com/lsst-dm/demo_deblender_sprint

          People

          • Assignee:
            yusra Yusra AlSayyad
            Reporter:
            yusra Yusra AlSayyad
            Watchers:
            Yusra AlSayyad
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Summary Panel