arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Wes McKinney <>
Subject Re: Write in HDFS
Date Tue, 25 Sep 2018 11:15:55 GMT
Installing the Hadoop client Java dependencies in Docker isn't sooo
bad if you start from a known working solution, e.g. something like:


It would be nice to be able to support libhdfs++ in Arrow, but someone
would need to step up and champion that development work
On Tue, Sep 25, 2018 at 7:08 AM Alberto Ramón <> wrote:
> I have Apache Arrow on Docker (outside Hadoop cluster)
> Write to HDFS using pyArrow can be difficult  solve in Docker all dependencies (Hadoop_home,
Java_home, ... )
> I don't know if use Native RPC access in Python is my best option or there is some alternative
> Some suggestion ??

View raw message