hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Daniel Cryans <jdcry...@apache.org>
Subject Re: HBase-0.20.0 randomRead
Date Tue, 18 Aug 2009 15:43:40 GMT
Murali,

I'm not reading the same thing as you.

client-0 Finished randomRead in 2867ms at offset 0 for 10000 rows

That means 2867 / 10000 = 0.2867ms per row. It's kinda fast.

J-D

On Tue, Aug 18, 2009 at 11:35 AM, Murali Krishna.
P<muralikpbhat@yahoo.com> wrote:
> Hi all,
>  (Saw a related thread on performance, but starting a different one because my setup
is slightly different).
>
> I have an one node setup with hbase-0.20(alpha). It has around 11million rows with ~250
regions. Each row with ~20 bytes sized key and ~4k sized value.
> Since my primary concern is randomRead, modified the performanceEvaluation code to read
from this particular table. The randomRead test gave following result.
>
> 09/08/18 08:20:41 INFO hbase.PerformanceEvaluation: client-1 Finished randomRead in 2813ms
at offset 10000 for 10000 rows
> 09/08/18 08:20:41 INFO hbase.PerformanceEvaluation: Finished 1 in 2813ms writing 10000
rows
> 09/08/18 08:20:41 INFO hbase.PerformanceEvaluation: client-0 Finished randomRead in 2867ms
at offset 0 for 10000 rows
> 09/08/18 08:20:41 INFO hbase.PerformanceEvaluation: Finished 0 in 2867ms writing 10000
rows
>
>
> So, looks like it is taking around 280ms per record. Looking at the latest hbase performance
claims, I was expecting it below 10ms. Am  I doing something basically wrong, since such
a hiuge difference :( ? Please help me fix the latency.
>
> The machine config is:
> Processors:    2 x Xeon L5420 2.50GHz (8 cores)
> Memory:        13.7GB
> 12 Disks of 1TB each.
>
> Let me know if you need anymore details
>
> Thanks,
> Murali Krishna

Mime
View raw message