arrow-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Erhardt (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ARROW-5019) [C#] ArrowStreamWriter doesn't work on a non-seekable stream
Date Tue, 26 Mar 2019 21:54:00 GMT
Eric Erhardt created ARROW-5019:
-----------------------------------

             Summary: [C#] ArrowStreamWriter doesn't work on a non-seekable stream
                 Key: ARROW-5019
                 URL: https://issues.apache.org/jira/browse/ARROW-5019
             Project: Apache Arrow
          Issue Type: Bug
          Components: C#
            Reporter: Eric Erhardt
            Assignee: Eric Erhardt


When writing to a non-seekable .NET Stream (like a network/socket stream), ArrowStreamWriter
will throw an exception:

 
{code:java}
Exception thrown: 'System.NotSupportedException' in System.Net.Sockets.dll
This stream does not support seek operations.
{code}
The reason this throws is because we are using `BastStream.Position` in the writer to calculate
the length of bytes that we've written to the stream. We don't need to use the Position in
order to calculate the lengths. We should be able to write an Arrow RecordBatch to a NetworkStream
directly. Today, we need to write to a MemoryStream, and then copy the MemoryStream to the
NetworkStream.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message