arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ARROW-41) C++: Convert table to std::vector of Struct arrays
Date Sun, 27 Mar 2016 02:23:25 GMT

    [ https://issues.apache.org/jira/browse/ARROW-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15213291#comment-15213291
] 

Wes McKinney commented on ARROW-41:
-----------------------------------

Note that {{arrow::Table}} (as compared with {{arrow::RowBatch}}), as currently defined, is
a chunked data structure: https://github.com/apache/arrow/blob/master/cpp/src/arrow/column.h#L71

> C++: Convert table to std::vector of Struct arrays
> --------------------------------------------------
>
>                 Key: ARROW-41
>                 URL: https://issues.apache.org/jira/browse/ARROW-41
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Wes McKinney
>
> This may require memory allocation depending on the chunking of the table columns. 
> While tables and struct type columns are semantically equivalent (and tables can be embedded
in other tables using struct types), the memory layout of a table may not be strictly contiguous.
For the purposes of putting data on the wire / in shared memory, it may be useful to offer
a conversion function to "structify" an in-memory logical Arrow table. See ARROW-24



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message