Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34975

Detailed performance characterization of the AP pipeline

    XMLWordPrintable

Details

    • Story
    • Status: To Do
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Followinging the Performance characterization sprint (DM-34623), profile the AP pipeline at a more detailed level and report on major components that are taking the most time.

      Attachments

        Issue Links

          Activity

            From my work on DM-32406, I have some possible concerns about the performance of the dipole fitter. On this ticket, I should check whether the "new" dipole fitter is taking a noticeable amount of time: there may be several places to speed it up, including: changing how the x/y variables are managed, pre-casting/creating everything as double or convincing lmfit to allow float32, changing epsfcn initial step size, using least_squares fitter instead of leastsq.

            Parejkoj John Parejko added a comment - From my work on DM-32406 , I have some possible concerns about the performance of the dipole fitter. On this ticket, I should check whether the "new" dipole fitter is taking a noticeable amount of time: there may be several places to speed it up, including: changing how the x/y variables are managed, pre-casting/creating everything as double or convincing lmfit to allow float32, changing epsfcn initial step size, using least_squares fitter instead of leastsq.
            ebellm Eric Bellm added a comment -

            In sprint planning 28 Nov. 2023, we discussed doing this after we've implemented DIASource history preloading so we can more easily test scaling of timeseries features, etc. in ap_association.

            ebellm Eric Bellm added a comment - In sprint planning 28 Nov. 2023, we discussed doing this after we've implemented DIASource history preloading so we can more easily test scaling of timeseries features, etc. in ap_association.

            People

              Parejkoj John Parejko
              sullivan Ian Sullivan
              Eric Bellm, Ian Sullivan, John Parejko, Krzysztof Findeisen
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:

                Jenkins

                  No builds found.