arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wes McKinney (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ARROW-550) [Format] Add a TensorMessage type
Date Fri, 17 Feb 2017 19:28:41 GMT

    [ https://issues.apache.org/jira/browse/ARROW-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15872365#comment-15872365
] 

Wes McKinney commented on ARROW-550:
------------------------------------

[~pcmoritz] we discussed this issue on the Arrow sync call yesterday. I think we should be
able to propose a design for C++ users that will meet your needs (including accommodating
arrays larger than 2G in the Arrow builder classes) -- I will draw up a patch when I can and
we can discuss. 

> [Format] Add a TensorMessage type
> ---------------------------------
>
>                 Key: ARROW-550
>                 URL: https://issues.apache.org/jira/browse/ARROW-550
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Format
>            Reporter: Wes McKinney
>
> Since all data message types at the moment are 1-dimensional, a "tensor" message will
contain an array of dimensions and an order flag (C order vs. Fortran order) to enable data
to be interpreted as multiple dimensions. This is similar to multidimensional arrays in APL
or Fortran or MATLAB, ndarrays in NumPy, etc.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message