arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Théo Matussière <t...@huggingface.co>
Subject [python] Table.filter outputs in memory with no option to direct it to memory map
Date Thu, 25 Mar 2021 15:18:50 GMT
Hi all,
Thanks for all the cool work on Arrow, it's definitely making things easier
for us :)

I'm wondering if there is a workaround for the current behaviour of
`Table.filter` that I'm seeing, in that its result goes to RAM even if the
table is memory mapped.

Here's an example code to highlight the behaviour:

[image: Screenshot 2021-03-25 at 16.11.31.png]

Thanks for the attention!
Théo

Mime
View raw message