Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-12858

Persist values of quantities calculated in pipe_analysis scripts

    XMLWordPrintable

    Details

    • Type: Story
    • Status: To Do
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: pipe_analysis
    • Labels:
      None
    • Team:
      Data Release Production

      Description

      To make the interactive QA analysis snappier, it would be great if the coaddAnalysis and visitAnalysis pipe_analysis scripts saved the results of their calculations before actually making the plots. This way the interactive plots could just read in the already-calculated values rather than repeating calculations.

        Attachments

          Issue Links

            Activity

            Hide
            tmorton Tim Morton [X] (Inactive) added a comment -

            This might require doing some more significant refactoring of how the pipe_analysis scripts work, and at some point it might also be worth splitting these tasks into pieces, where one task does all the calculations and writes the data and then another task makes the plots. Given the current structure of the code, it might not be worth trying to implement this ticket before doing this refactoring; perhaps Lauren MacArthur you have a better sense?

            Show
            tmorton Tim Morton [X] (Inactive) added a comment - This might require doing some more significant refactoring of how the pipe_analysis scripts work, and at some point it might also be worth splitting these tasks into pieces, where one task does all the calculations and writes the data and then another task makes the plots. Given the current structure of the code, it might not be worth trying to implement this ticket before doing this refactoring; perhaps Lauren MacArthur you have a better sense?
            Hide
            yusra Yusra AlSayyad added a comment -

            As pipe_analysis is migrating to gen3's analysis_drp the spirit of this request is getting fulfilled. Paging Sophie Reed, in case I'm wrong.

            Show
            yusra Yusra AlSayyad added a comment - As pipe_analysis is migrating to gen3's analysis_drp the spirit of this request is getting fulfilled. Paging Sophie Reed , in case I'm wrong.
            Hide
            sophiereed Sophie Reed added a comment -

            The way analysis_drp is set up this should be much easier.

            Show
            sophiereed Sophie Reed added a comment - The way analysis_drp is set up this should be much easier.

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              tmorton Tim Morton [X] (Inactive)
              Watchers:
              Jim Bosch, John Swinbank, Lauren MacArthur, Sophie Reed, Tim Morton [X] (Inactive), Yusra AlSayyad
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:

                  Jenkins

                  No builds found.