Add pyarrow to the shared stack, to support DM-13793, DM-13770, DM-13876, etc. Also, if it doesn't break anything else, pandas 0.22 would be a good idea, too (improvements in parquet integration).
Attachments
Issue Links
relates to
DM-13673Add pipe_analysis dependencies to shared-stack bootstrap
Done
DM-14224testParquet.py unit test hangs at "collecting 0 items"
There must be something funky with the stack-installed pyarrow (not pandas). When I pip install --user --ignore-installed pyarrow, then my test runs fine; when I remove that, it hangs with the signal 11.
Tim Morton [X] (Inactive)
added a comment - There must be something funky with the stack-installed pyarrow (not pandas). When I pip install --user --ignore-installed pyarrow , then my test runs fine; when I remove that, it hangs with the signal 11 .
Tim Morton [X] (Inactive)
added a comment - Sophie Reed just hit a signal 11 issue trying to use the shared stack and my parquet stuff, too, so there's something that's definitely not right.
That sounds scarily like an ABI incompatibility creeping in somewhere, but it's very hard to tell where. This is why I'm scared of installing stuff into the stack using Conda.
I'll play around to see if I can get something which works, but this may be effectively insoluble within the constraints that Conda puts upon us.
John Swinbank
added a comment - That sounds scarily like an ABI incompatibility creeping in somewhere, but it's very hard to tell where. This is why I'm scared of installing stuff into the stack using Conda.
I'll play around to see if I can get something which works, but this may be effectively insoluble within the constraints that Conda puts upon us.
Per DM-15494, this is now working in /software/lsstsw/stack. I don't propose to spend further effort updating old stacks unless there's a critical need, so I reckon we can close this issue. Tim Morton [X] (or anybody else) please reopen if you disagree.
John Swinbank
added a comment - - edited Per DM-15494 , this is now working in /software/lsstsw/stack . I don't propose to spend further effort updating old stacks unless there's a critical need, so I reckon we can close this issue. Tim Morton [X] (or anybody else) please reopen if you disagree.
People
Assignee:
John Swinbank
Reporter:
Tim Morton [X] (Inactive)
Reviewers:
Tim Morton [X] (Inactive)
Watchers:
John Swinbank, Tim Jenness, Tim Morton [X] (Inactive)
There must be something funky with the stack-installed pyarrow (not pandas). When I pip install --user --ignore-installed pyarrow, then my test runs fine; when I remove that, it hangs with the signal 11.