hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ismaël Mejía <ieme...@gmail.com>
Subject Re: Mini announcement HBase connector for Apache Beam
Date Thu, 23 Feb 2017 13:49:50 GMT
Solomon, it is so great you answered, thanks a lot, you saved me with the
idea of using the Protobuf serialization for the Coders, it was quite
tricky to achieve a similar API to what you guys have in BigTable, but that
helped me a lot and I think after looking what you did I could design an
API that is at the same time natural for the HBase users and for the
Beam/Bigtable ones.

Thanks again,

ps. I would eventually jump into dev to ask some pending questions for
future work (subsplits and dynamic work rebalancing) so may be I will be
bothering you or other guys in the mailing list again.

On Wed, Feb 22, 2017 at 8:07 PM, Solomon Duskis <sduskis@gmail.com> wrote:

> That's an amazing accomplishment, and a great collaboration!  I'm happy and
> humbled that you were able to use the work we did over the last couple of
> years.
> On Wed, Feb 22, 2017 at 6:27 AM, Ismaël Mejía <iemejia@gmail.com> wrote:
> > ​Hello,
> >
> > I have been working in the last weeks on a connector to use HBase in
> Apache
> > Beam (the evolution of Google’s Dataflow model), and it was finally
> merged
> > today.
> >
> > https://github.com/apache/beam/tree/master/sdks/java/io/hbase
> >
> > This message is a call for those interested on using HBase with Apache
> Beam
> > to try it and report any issue or additional need not covered by the
> > current version of the IO. I will be more than happy to address any
> issue.
> >
> > Of course, for the more hardcore HBase contributors, I wouldn’t mind if
> > some of you guys could take a look and give me feedback on stuff I can
> > improve (or even better if you are  interested to contribute your
> > ideas/improvements in our community).
> >
> > Finally I want to thank you guys for your work on HBase, it was really
> nice
> > to use your APIs, and HBaseTestingUtility was a life-saver to test my
> > implementation.
> >
> > Thanks,
> > Ismaël Mejía
> >
> > ps. I don’t know if Solomon Duskis still follows this mailing list, but
> > just in case, thanks a lot Solomon, your ideas for Google’s Cloud
> Dataflow
> > really had a profound influence on my implementation.​
> >

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message