arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Philipp Moritz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ARROW-100) [C++] Computing RowBatch size
Date Wed, 13 Apr 2016 01:53:25 GMT

    [ https://issues.apache.org/jira/browse/ARROW-100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15238398#comment-15238398
] 

Philipp Moritz commented on ARROW-100:
--------------------------------------

Thanks for your answers!

Looking into it a bit more, it should be as simple as implementing DataHeaderSize (by calling
WriteDataHeader and getting the resulting buffer size) and adding TotalBytes to its result.
Assembling the Flatbuffer header should be fast enough, or do you see a better way to estimate
the size?

> [C++] Computing RowBatch size
> -----------------------------
>
>                 Key: ARROW-100
>                 URL: https://issues.apache.org/jira/browse/ARROW-100
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++
>            Reporter: Philipp Moritz
>
> Hi,
> thank you guys for this project, I'm really enjoying what I've seen so far!
> There is an unimplemented method for getting the total size of objects:
> int64_t GetRowBatchSize(const RowBatch* batch);
> Has somebody already started to implement it or thought about how to do it?
> It could be done by recursively adding up all the involved buffer sizes, build the metadata
and add its size. Let me know if you want me to create a draft of the implementation.
> -- Philipp.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message