Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-22125

Consider upgrading pyarrow to 0.15.1 due to memory leak in 0.13

    Details

    • Story Points:
      0.1
    • Team:
      Architecture

      Description

      There's a memory leak in pyarrow 0.13.1 when reading/writing Pandas to parquet.

      https://github.com/apache/arrow/issues/2624

      This is fixed in 0.15.1.

      I'd like to suggest upgrading the required pyarrow in the stack to at least 0.15.1.

      Yusra AlSayyad What do you think?

        Attachments

          Issue Links

            Activity

            No work has yet been logged on this issue.

              People

              • Assignee:
                tjenness Tim Jenness
                Reporter:
                wmwood-vasey Michael Wood-Vasey
                Watchers:
                Brian Van Klaveren, John Swinbank, Michael Wood-Vasey, Tim Jenness, Yusra AlSayyad
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Summary Panel