arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wes McKinney <wesmck...@gmail.com>
Subject Re: Is there a `write_record_batch` method corresonding to `pa.ipc.read_record_batch`?
Date Thu, 22 Oct 2020 14:15:04 GMT
Use RecordBatch.serialize to do this.

On Wed, Oct 21, 2020 at 11:18 PM Micah Kornfield <emkornfield@gmail.com>
wrote:

> Hi Shawn,
> This method exists in the C++ implementation [1], so it is likely
> reasonable to expose some form in python (I couldn't find it either in
> pyarrow).  This should be reasonable straight-forward (you could follow the
> path taken for read implementation) if it is something you wanted to
> contribute.
>
> Thanks,
> -Micah
>
> [1]
> https://github.com/apache/arrow/blob/3694794bdfd0677b95b8c95681e392512f1c9237/cpp/src/arrow/ipc/writer.h#L169
>
> On Mon, Oct 12, 2020 at 12:38 AM Shawn Yang <shawn.ck.yang@gmail.com>
> wrote:
>
>> I want to write a record batch as ipc message separately without writing
>> a schema. In my case, the schema is known to peers ahead of time. I noticed
>> arrow java already has this method
>> `org.apache.arrow.vector.ipc.message.MessageSerializer#serialize(org.apache.arrow.vector.ipc.WriteChannel,
>> org.apache.arrow.vector.ipc.message.ArrowRecordBatch)`
>>
>

Mime
View raw message