arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-801) [JAVA] Provide direct access to underlying buffer memory addresses in consistent way without generating garbage or large amount indirections
Date Mon, 10 Apr 2017 18:06:41 GMT
Jacques Nadeau created ARROW-801:
------------------------------------

             Summary: [JAVA] Provide direct access to underlying buffer memory addresses in
consistent way without generating garbage or large amount indirections
                 Key: ARROW-801
                 URL: https://issues.apache.org/jira/browse/ARROW-801
             Project: Apache Arrow
          Issue Type: Bug
          Components: Java - Vectors
            Reporter: Jacques Nadeau


When working with Arrow vectors recently, we observed a situation where our time was dominated
 by calls to getFieldBuffers() to be able to retrieve memory addresses (22s out of 26s total
for a piece of code). We should provide a direct mechanism to access this data so we can avoid
all the extra indirection and object creation. 

A proposal:
getBitAddress();
getDataAddress();
getOffsetAddress();

These interfaces would be made available at the FieldVector interface and simply throw UnsupportedOperationException
where not supported.

Unsupported Operations: 
data for list type
offset for fixed width types
data and offset for struct type
data for union type



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message