hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From anil gupta <anilgupt...@gmail.com>
Subject Re: Maximizing throughput
Date Fri, 11 Jan 2013 04:42:06 GMT
Is flushCommits true or false?

On Thu, Jan 10, 2013 at 8:40 PM, Anoop Sam John <anoopsj@huawei.com> wrote:

> Hi
>        You mind telling the configs that you changed and set? BTW which
> version of HBase you are using?
>
> -Anoop-
> ________________________________________
> From: Bryan Keller [bryanck@gmail.com]
> Sent: Friday, January 11, 2013 10:01 AM
> To: user@hbase.apache.org
> Subject: Maximizing throughput
>
> I am attempting to configure HBase to maximize throughput, and have
> noticed some bottlenecks. In particular, with my configuration, write
> performance is well below theoretical throughput. I have a test program
> that inserts many rows into a test table. Network I/O is less than 20% of
> max, and disk I/O is even lower, maybe around 5% max on all boxes in the
> cluster. CPU is well below than 50% max on all boxes. I do not see any I/O
> waits or anything in particular than raises concerns. I am using iostat and
> iftop to test throughput. To determine theoretical max, I used dd and
> iperf. I have spent quite a bit of time optimizing the HBase config
> parameters, optimizing GC, etc., and am familiar with the HBase book online
> and such.
>



-- 
Thanks & Regards,
Anil Gupta

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message