Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-29407

visitSummary files should not persist the detector

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Done
    • Resolution: Done
    • Fix Version/s: None
    • Component/s: pipe_tasks
    • Labels:
    • Story Points:
      1
    • Epic Link:
    • Sprint:
      DRP S21a (Dec Jan)
    • Team:
      Data Release Production
    • Urgent?:
      No

      Description

      The visitSummary files currently persist the detector for each row, but it turns out that this makes the files 140x larger than otherwise, and take 50x longer to read than otherwise. Persisting the detector in here is definitely not necessary; all we need is the id and that is persisted as the row index.

        Attachments

          Activity

          No work has yet been logged on this issue.

            People

            Assignee:
            erykoff Eli Rykoff
            Reporter:
            erykoff Eli Rykoff
            Reviewers:
            John Parejko
            Watchers:
            Eli Rykoff, John Parejko
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Jenkins

                No builds found.