arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ARROW-317) [C++] Implement zero-copy Slice method on arrow::Buffer that retains reference to parent
Date Thu, 13 Oct 2016 20:32:21 GMT

    [ https://issues.apache.org/jira/browse/ARROW-317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573092#comment-15573092
] 

Wes McKinney commented on ARROW-317:
------------------------------------

I implemented this in pandas prototyping:

https://github.com/pandas-dev/pandas2/pull/40/files#diff-3d95cc22572f59dbfc29d31c19c9bed4R41

per https://github.com/pandas-dev/pandas2/issues/44 my working plan is to make pandas depend
on libarrow so we can all this buffer wrangling / memory management in one place

> [C++] Implement zero-copy Slice method on arrow::Buffer that retains reference to parent
> ----------------------------------------------------------------------------------------
>
>                 Key: ARROW-317
>                 URL: https://issues.apache.org/jira/browse/ARROW-317
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Wes McKinney
>
> This will help prevent referenced memory from being garbage-collected while it is referenced
by other buffers (for example, in an IPC setting, where we construct Arrow vectors/arrays
without copying the input memory).
> Closely related to this: resizeable buffers that are referenced by other buffers should
return error status when calling {{Resize}} (if possible). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message