Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-18742

Speed up DcrModel convergence

    Details

    • Story Points:
      10
    • Epic Link:
    • Sprint:
      AP S19-5
    • Team:
      Alert Production

      Description

      The current implementation of the iterative forward modeling algorithm used to construct a DCR model appears to suppress differences between the subfilter model planes. This is currently overcome by running many iterations of modeling, which eventually recovers the missing frequency structure. While working on DM-17528 I developed code that overcomes this suppression and speeds up convergence by an order of magnitude, but it is not fully verified. This ticket is to rigorously develop and test that preliminary code.

        Attachments

          Activity

          Hide
          sullivan Ian Sullivan added a comment -

          Please take a look at these changes to my DCR modeling code when you get a chance.

          The changes involving the new config option accelerateModel speed up convergence of the model by roughly an order of magnitude, but they do not have a rigorous mathematical basis. Frequency regularization appears to be suppressing the real differences between DCR model planes, but it also suppresses significant artifacts. The suppressed real power is slowly recovered after many iterations. This change preserves the artifact suppression while recovering the lost power faster.

          Show
          sullivan Ian Sullivan added a comment - Please take a look at these changes to my DCR modeling code when you get a chance. The changes involving the new config option accelerateModel speed up convergence of the model by roughly an order of magnitude, but they do not have a rigorous mathematical basis. Frequency regularization appears to be suppressing the real differences between DCR model planes, but it also suppresses significant artifacts. The suppressed real power is slowly recovered after many iterations. This change preserves the artifact suppression while recovering the lost power faster.
          Hide
          sullivan Ian Sullivan added a comment -

          Note that there are two pull requests, one in ip_diffim and another in pipe_tasks that may not get picked up by Jira.

          Show
          sullivan Ian Sullivan added a comment - Note that there are two pull requests, one in ip_diffim  and another in pipe_tasks  that may not get picked up by Jira.
          Hide
          krzys Krzysztof Findeisen added a comment -

          Looks good.

          Show
          krzys Krzysztof Findeisen added a comment - Looks good.

            People

            • Assignee:
              sullivan Ian Sullivan
              Reporter:
              sullivan Ian Sullivan
              Reviewers:
              Krzysztof Findeisen
              Watchers:
              Ian Sullivan, John Swinbank, Krzysztof Findeisen
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: