arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anthony Abate (Jira)" <j...@apache.org>
Subject [jira] [Created] (ARROW-6681) [C# -> R] - Record Batches in reverse order?
Date Wed, 25 Sep 2019 03:33:00 GMT
Anthony Abate created ARROW-6681:
------------------------------------

             Summary: [C# -> R] - Record Batches in reverse order?
                 Key: ARROW-6681
                 URL: https://issues.apache.org/jira/browse/ARROW-6681
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C#
    Affects Versions: 0.14.1
            Reporter: Anthony Abate


Are 'RecordBatches' being in C# being written in reverse order?

I made a simple test which creates a single row per record batch of 0 to 99 and attempted
to read this in R. To my surprise batch(0) in R had the value 99 not 0

This may not seem like a big deal, however when dealing with 'huge' files, its more efficient
to use Record Batches / index lookup than attempting to load the entire file into memory.

Having the order consistent within the different language / API seems only to make sense -
for now I can work around this by reversing the order before writing.

 

https://github.com/apache/arrow/issues/5475

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message