hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sylvain Hellegouarch" ...@defuze.org>
Subject Re: Is the thrift server a likely bottleneck?
Date Thu, 03 Sep 2009 08:44:36 GMT

> The api is htable.setAutoCommit or thereabouts. The htable normally calls
> to
> hbase rs every put() call, but if you turn off autocommit it will batch up
> and send a bunch in one rpc.
>
> I cannot say for certain about the thrift batch commit, don't have the
> code
> up right now. Fairly simple codepath though.

I will look at it then.

>
> Finally, I found a simple map reduce was 3x slower when written in jython.
> I
> haven't used it since.

Oh we wouldn't use Jython for M/R but directly Java. That being said,
Jython is meant to be much more efficient than it used to... the rumour
has it anyway.

Cheers,
- Sylvain
-- 
Sylvain Hellegouarch
http://www.defuze.org

Mime
View raw message