hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anil gupta <anilgupt...@gmail.com>
Subject Re: Maximizing throughput
Date Fri, 11 Jan 2013 04:47:02 GMT
Sorry, I meant to ask about "setAutoFlush". Is setAutoFlush true or false?

On Thu, Jan 10, 2013 at 8:42 PM, anil gupta <anilgupta84@gmail.com> wrote:

> Is flushCommits true or false?
>
>
> On Thu, Jan 10, 2013 at 8:40 PM, Anoop Sam John <anoopsj@huawei.com>wrote:
>
>> Hi
>>        You mind telling the configs that you changed and set? BTW which
>> version of HBase you are using?
>>
>> -Anoop-
>> ________________________________________
>> From: Bryan Keller [bryanck@gmail.com]
>> Sent: Friday, January 11, 2013 10:01 AM
>> To: user@hbase.apache.org
>> Subject: Maximizing throughput
>>
>> I am attempting to configure HBase to maximize throughput, and have
>> noticed some bottlenecks. In particular, with my configuration, write
>> performance is well below theoretical throughput. I have a test program
>> that inserts many rows into a test table. Network I/O is less than 20% of
>> max, and disk I/O is even lower, maybe around 5% max on all boxes in the
>> cluster. CPU is well below than 50% max on all boxes. I do not see any I/O
>> waits or anything in particular than raises concerns. I am using iostat and
>> iftop to test throughput. To determine theoretical max, I used dd and
>> iperf. I have spent quite a bit of time optimizing the HBase config
>> parameters, optimizing GC, etc., and am familiar with the HBase book online
>> and such.
>>
>
>
>
> --
> Thanks & Regards,
> Anil Gupta




-- 
Thanks & Regards,
Anil Gupta

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message