arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Nuernberger <ch...@techascent.com>
Subject Re: How to write Arrow Table to Parquet file in Java
Date Thu, 12 Nov 2020 23:22:47 GMT
We use Clojure and have a dataframe library that does this:

https://github.com/techascent/tech.ml.dataset/

On Thu, Nov 12, 2020 at 2:44 PM Jason Sachs <jmsachs@gmail.com> wrote:

> The Python examples in https://arrow.apache.org/docs/python/parquet.html
> are wonderful and really easy to get started; in particular this one:
>
>     writer = pq.ParquetWriter('example2.parquet', table.schema)
>     for i in range(3):
>         writer.write_table(table)
>     writer.close()
>
> How would I do something similar in Java? Arrow and Parquet libraries
> don't seem to know about one another.
>
> I have looked a little bit at the Javadocs at
> https://www.javadoc.io/doc/org.apache.parquet/parquet-column/1.10.0/index.html
> but my head is spinning. (although for the record most of my work is in
> Python and a coworker is handling the Java side... he is only slightly less
> confused, though)
>

Mime
View raw message