arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <emkornfi...@gmail.com>
Subject Re: Implementation of Arrow table to Parquet File Writer
Date Thu, 09 Jan 2020 00:32:05 GMT
There is not yet anything checked in in Arrow.  There is an open PR to wrap
the C++ parquet writer via JNI, however the C++ implementation does not yet
supported nested columns.

On Thu, Jan 2, 2020 at 3:06 AM saurabh pratap singh <saurabh.cse16@gmail.com>
wrote:

> forgot to mention using Java
>
> On Thu, Jan 2, 2020 at 3:41 PM saurabh pratap singh <
> saurabh.cse16@gmail.com> wrote:
>
>> Hi
>>
>> I wanted to know whether there is a support/library available for
>> writing arrow tables as parquet files.
>> Meanwhile I tried writing my own converter where I am using
>> SchemaConverter provided by arrow (to convert arrow schema to parquet )
>> Then Converting Arrow table to Group(ParquetExample Group reader/writer as
>> a reference from parquet-mr) and dump as parquet .This works for
>> primitive types without any issues but for nested types it will be little
>> complicated so wanted to know if anything like this already exists or
>> planned in near future .
>>
>> Thanks in advance.Please let me know if some other information is
>> required from my side.
>>
>>

Mime
View raw message