Uploaded image for project: 'Data Management'
  1. Data Management
  2. DM-34875

Migrate PipelineTasks with DataFrame connections to ArrowTable

    XMLWordPrintable

Details

    • Story
    • Status: To Do
    • Resolution: Unresolved
    • None
    • pipe_tasks
    • None
    • Data Release Production
    • No

    Description

      Implements the second step of RFC-844 RFC-995, in which tasks that use DataFrame connections are changed to use ArrowTable instead, converting to/from pandas internally where needed.

      This may be an umbrella ticket for work done on other tickets; it should not be closed until no DataFrame tasks exist, unless a new implementation ticket is added to RFC-844 RFC-995 to cover any that remain.

      Attachments

        Issue Links

          Activity

            jbosch Jim Bosch added a comment -

            I'm repurposing this as an RFC-995, since that supersedes the original triggering RFC (RFC-844).

            jbosch Jim Bosch added a comment - I'm repurposing this as an RFC-995 , since that supersedes the original triggering RFC ( RFC-844 ).

            People

              jbosch Jim Bosch
              jbosch Jim Bosch
              Eric Bellm, Jim Bosch
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:

                Jenkins

                  No builds found.