camel-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sotaro Kimura <rfbrin...@gmail.com>
Subject Re: [camel-hbase]camel-hbase component performance improvement
Date Mon, 26 Nov 2012 23:09:51 GMT
Hi Willem.

Thanks for reply.

I created [CAMEL-5824] at JIRA.
And submited patch.

[CAMEL-5824] camel-hbase - HBase data access performance improvement

regards.

2012/11/26 Willem jiang <willem.jiang@gmail.com>:
> Hi
>
> Thanks for the patch. As you know we can only apply the patch which is granted with ASL.
> Please fill a JIRA[1] and submit the patch (the patch will be granted with ASL by default),
then we can put it into the camel svn repository.
>
>
> --
> Willem Jiang
>
> Red Hat, Inc.
> FuseSource is now part of Red Hat
> Web: http://www.fusesource.com | http://www.redhat.com
> Blog: http://willemjiang.blogspot.com (http://willemjiang.blogspot.com/) (English)
>           http://jnn.javaeye.com (http://jnn.javaeye.com/) (Chinese)
> Twitter: willemjiang
> Weibo: willemjiang
>
>
>
>
> On Monday, November 26, 2012 at 5:55 AM, Sotaro Kimura wrote:
>
>> Hi, all.
>>
>> I'm testing hbase client using camel-hbase component.
>> But in this test, data put performance is low.
>> ( about 20 put operation / second, I use Core i7 2700K machine.)
>>
>> I confirmed performance bottleneck.
>> And I find bottleneck below
>>
>> - Everytime camel-hbase component put data,
>> camel-hbase component creates and closes HTableInterface.
>> - But HTableInterface create cost is high.
>> So camel-hbase component performance is low.
>>
>> I modified HBaseProducer using HTablePool,
>> data put performance is improved 20 operetion/second to 200 operation/second.
>>
>> Modified source is below( and attach patchfile.txt)
>> -HBaseProducer.java(orig)
>> ----------------------------
>> 103 } finally {
>> 104 table.close();
>> 105 }
>> ----------------------------
>>
>> -HBaseProducer.java(improved)
>> ----------------------------
>> 103 } finally {
>> 104 tablePool.putTable(table);
>> 105 }
>> ----------------------------
>>
>> What should I do for contribution it.
>>
>> regards.
>>
>> --
>> #################################
>> Sotaro Kimura
>> <rfbringer@gmail.com (mailto:rfbringer@gmail.com)>
>> #################################
>>
>>
>> Attachments:
>> - patchfile.txt
>>
>
>
>



-- 
#################################
Sotaro Kimura
<rfbringer@gmail.com>
#################################

Mime
View raw message