arrow-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Micah Kornfield <>
Subject Re: Arrow and HBase
Date Wed, 07 Oct 2020 05:42:32 GMT
Hi Matt,
I'm not sure which presentations you are referring to, but if this is in
reference to the diagram on the Overview page [1].  That is aspirational
there are some integrations in various levels of depth for some of the
technologies but it isn't the final state.

To my knowledge there isn't a library within the Arrow project itself that
currently connects to HBase and does any sort of HBase schema to Arrow
schema conversion, but i think there might be some interest in building one
at some point.

There was a thread a little while ago on using Arrow within Redis [2] which
might be of interest depending on how you are using HBase.

Hope this helps.



On Tue, Oct 6, 2020 at 8:21 AM Matt Duffy <> wrote:

> I've seen several presentations listing HBase as a technology that
> integrates with Arrow dataframes.  Is there an example for reading/writing
> to HBase from an Arrow dataframe?  I'm hoping to utilize Arrow to expedite
> the translation between HBase and Spark or Pandas.

View raw message